Home
Patent Search
IMT Blog
REGISTER
|
SIGN IN
United States Patent Application
20040159773
Kind Code
A1
Fein, Howard ; et al.
August 19, 2004
Imaging system and methodology
Abstract
An imaging system, methodology, and various applications are provided to facilitate optical imaging performance. The system contains a sensor having one or more receptors and an image transfer medium to scale the sensor and receptors in accordance with resolvable characteristics of the medium, and as defined with certain ratios. A computer, memory, and/or display associated with the sensor provides storage and/or display of information relating to output from the receptors to produce and/or process an image, wherein a plurality of illumination sources can also be utilized in conjunction with the image transfer medium. The image transfer medium can be configured as a k-space filter that correlates projected receptor size to a diffraction-limited spot associated with the image transfer medium, wherein the projected receptor size can be unit-mapped within a certain ratio to the size of the diffraction-limited spot, both in the object plane.
Inventors:
Fein; Howard
(Richmond Heights, OH)
, Cartlidge; Andrew G.
(Palm Beach Gardens, FL
)
Correspondence Name and Address:
1900 EAST 9TH STREET, NATIONAL CITY CENTER 24TH FLOOR,
AMIN & TUROCY, LLP
CLEVELAND
OH
44114
US
Series Code:
758836
Filed:
January 16, 2004
U.S. Current Class:
250/208.1
U.S. Class at Publication:
250/208.1
Intern'l Class:
H01L 027/00
Claims
What is claimed is:
1. An imaging system, comprising: a sensor comprising pixels, the pixels having a pixel area of about 0.01 microns or more and about 600
microns.sup.2 or less; and an image transfer medium having a diffraction limited spot size area in the object plane of about 0.0003 microns.sup.2
or more and about 600 microns or less, wherein pixels projected through the image transfer medium have a projected pixel area in the object plane of about 0.0003 microns.sup.2 or more and about 600 microns or less, the ratio of the projected pixel area in the object plane to the diffraction limited spot size area in the object plane is from about 5:1 to about 1:12.
2. The imaging system of claim 1, wherein the projected pixel area is about 0.001 microns or more and about 200 microns or less, the diffraction limited spot size area is about 0.001 microns.sup.2 or more and about 200 microns.sup.2 or less, and the ratio of the projected pixel area to the diffraction limited spot size area is from about 3.5:1 to about 1:8.
3. The imaging system of claim 1, wherein the projected pixel area is about 0.01 microns or more and about 100 microns.sup.2 or less, the diffraction limited spot size area is about 0.01 microns.sup.2 or more and about 100 microns.sup.2 or less, and the ratio of the projected pixel area to the diffraction limited spot size area is from about 3:1 to about 1:6.
4. The imaging system of claim 1, wherein the sensor comprises pixels having substantially the same pixel area and substantially the same shape.
5. The imaging system of claim 1, wherein the sensor comprises a first subset of pixels having a first pixel area and a second a subset of pixels having a second pixel area, the first pixel area different from the second pixel area.
6. The imaging system of claim 1, wherein the image transfer medium comprises at least two lenses.
7. The imaging system of claim 1, wherein the sensor comprises a plurality of stacked pixels, where each pixel in a stack has substantially the same size.
8. The imaging system of claim 7, wherein each stack of pixels comprises two, three or four pixels.
9. An imaging system, comprising: a sensor comprising pixels, the pixels having a pixel pitch of about 0.1 microns or more and about 20 microns or less; and an image transfer medium having a diffraction limited spot in an object plane having a diameter of about 0.01 microns or more and about 20 microns or less, wherein pixels projected through the image transfer medium have a projected pixel diameter in the object plane of about 0.01
microns or more and about 20 microns or less, the ratio of the projected pixel pitch in the object plane to the diffraction limited spot diameter in the object plane is from about 1:1.9 to about 1.9:1.
10. The imaging system of claim 9, wherein the projected pixel pitch is about 0.05 microns or more and about 15 microns or less, the diffraction limited spot diameter is about 0.05 microns or more and about 15 microns or less, the ratio of the projected pixel pitch to the diffraction limited spot diameter is from about 1:1.5 to about 1.5:1.
11. The imaging system of claim 9, wherein the projected pixel pitch is about 0.1 microns or more and about 10 microns or less, the diffraction limited spot diameter is about 0.1 microns or more and about 10 microns or less, the ratio of the projected pixel pitch to the diffraction limited spot diameter is from about 1:1.3 to about 1.3:1.
12. The imaging system of claim 9, wherein the image transfer medium comprises an objective lens system and a transfer lens system.
13. The imaging system of claim 9, wherein the objective lens system comprises a single objective lens or a plurality of lenses.
14. The imaging system of claim 9, wherein the sensor comprises a plurality of stacked pixels, each pixel in a stack has substantially the same size, and each pixel in a stack captures a different range of wavelengths of light.
15. The imaging system of claim 9, wherein the image transfer medium having a diffraction limited spot in an image plane having a diameter of about 0.1 microns or more and about 20 microns or less, wherein the ratio of the pixel pitch to the diffraction limited spot in the image plane is from about 1:1.25 to about 1.25:1.
16. An imaging system, comprising: a sensor comprising pixels, the pixels having a pixel width of about 0.1 microns or more and about 20 microns or less; and an image transfer medium having a diffraction limited spot in an object plane having a diameter of about 0.01 microns or more and about 20 microns or less, wherein pixels projected through the image transfer medium have a projected pixel width in the object plane of about 0.01
microns or more and about 20 microns or less, the ratio of the projected pixel width in the object plane to the diffraction limited spot diameter in the object plane is from about 1:1.9 to about 1.9:1.
17. The imaging system of claim 16, wherein the pixels have at least one of a rectangular shape and a square shape.
18. The imaging system of claim 16, wherein the projected pixel width is about 0.05 microns or more and about 15 microns or less, the diffraction limited spot diameter is about 0.05 microns or more and about 15 microns or less, the ratio of the projected pixel width to the diffraction limited spot diameter is from about 1:1.7 to about 1.7:1.
19. The imaging system of claim 16, wherein the projected pixel width is about 0.1 microns or more and about 10 microns or less, the diffraction limited spot diameter is about 0.1 microns or more and about 10 microns or less, the ratio of the projected pixel width to the diffraction limited spot diameter is from about 1:1.2 to about 1.2:1.
20. The imaging system of claim 16 further comprising an illumination source providing at least about 75% of illumination energy having a wavelength range from about 100 nm to about 2,000 nm.
Description
RELATED APPLICATIONS
[0001] This application is a continuation-in-part of U.S. Patent Application of Ser. No. 10/616,829 which was filed Jul. 10, 2003 entitled IMAGING SYSTEM, METHODOLOGY, AND APPLICATIONS EMPLOYING RECIPROCAL SPACE OPTICAL DESIGN, which is a continuation-in-part of U.S. patent application Ser. No. 10/189,326 which was filed Jul. 2, 2002 entitled IMAGING SYSTEM AND METHODOLOGY EMPLOYING RECIPROCAL SPACE OPTICAL DESIGN, which is a continuation-in-part of U.S. patent application Ser. No. 09/900,218, which was filed Jul. 6, 2001, entitled IMAGING SYSTEM AND METHODOLOGY EMPLOYING RECIPROCAL SPACE OPTICAL DESIGN, all of which are incorporated herein by reference.
TECHNICAL FIELD
[0002] The present invention relates generally to image and optical systems, and more particularly to a system and method to facilitate imaging performance via an image transfer medium that projects characteristics of a sensor to an object field of view.
BACKGROUND OF THE INVENTION
[0003] Microscopes facilitate creating a large image of a tiny object. Greater magnification can be achieved if the light from an object is made to pass through two lenses compared to a simple microscope with one lens. A compound microscope has two or more converging lenses, placed in line with one another, so that both lenses refract the light in turn. The result is to produce an image that is magnified with improved quality in Resolved Magnification and other image parameters than either lens could alone. Light illuminating the object first passes through a short focal length lens or lens group, called the objective, and then travels on some distance before being passed through a longer focal length lens or lens group, called the eyepiece. A lens group is often simply referred to singularly as a lens. Usually these two lenses are held in paraxial relationship to one another, so that the axis of one lens is arranged to be in the same orientation as the axis of the second lens. It is the nature of the lenses, their properties, their relationship, and the relationship of the objective lens to the object that determines how a highly magnified image is produced in the eye of the observer.
[0004] The first lens or objective is usually a small lens with a very small focal length. A specimen or object is placed in the path of a light source with sufficient intensity to illuminate as desired. The objective lens is then lowered until the specimen is very close to, but not quite at the focal point of the lens. Light leaving the specimen and passing through the objective lens produces a real, inverted and magnified image behind the lens, in the microscope at a point generally referred to as the intermediate image plane. The second lens or eyepiece has a longer focal length and is placed in the microscope so that the image produced by the objective lens falls closer to the eyepiece than one focal length (that is, inside the focal point of the lens). The image from the objective lens now becomes the object for the eyepiece lens. As this object is inside one focal length, the second lens refracts the light in such a way as to produce a second image that is virtual, inverted and magnified. This is the final image seen by the eye of the observer.
[0005] Alternatively, common infinity space or infinity corrected design microscopes employ objective lenses with infinite conjugate properties such that the light leaving the objective is not focused, but is a flux of parallel rays which do not converge until after passing through a tube lens where the projected image is then located at the focal point of the eyepiece for magnification and observation. Many microscopes, such as the compound microscope described above, are designed to provide images of certain quality to the human eye through an eyepiece. Connecting a Machine Vision Sensor, such as a Charge Coupled Device (CCD) sensor, to the microscope so that an image may be viewed on a monitor presents difficulties. This is because the image quality provided by the sensor and viewed by a human eye decreases as compared to an image viewed by a human eye directly through an eyepiece. As a result, conventional optical systems for magnifying, observing, examining, and analyzing small items often require the careful attention of a technician monitoring the process through an eyepiece. It is for this reason, as well as others, that Machine-Vision or computer-based image displays from the aforementioned image sensor displayed on a monitor or other output display device are not of quality perceived by the human observer through the eyepiece.
SUMMARY OF THE INVENTION
[0006] The following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. This summary is not an extensive overview of the invention. It is intended to neither identify key or critical elements of the invention nor delineate the scope of the invention. Its sole purpose is to present some concepts of the invention in a simplified form as a prelude to the more detailed description that is presented later.
[0007] The present invention relates to a system and methodology that facilitates imaging performance of optical imaging systems. In regard to several optical and/or imaging system parameters, many orders of performance enhancement can be realized over conventional systems (e.g., greater effective resolved magnification, larger working distances, increased absolute spatial resolution, increased spatial field of view, increased depth of field, Modulation Transfer Function of about 1, oil immersion objectives and eye pieces not required). This is achieved by adapting an image transfer medium (e.g., one or more lenses, fiber optical media, or other media) to a sensor having one or more receptors (e.g., photodetectors, pixels) such that the receptors of the sensor are effectively scaled (e.g., "mapped", "sized", "projected", "matched", "reduced") to occupy an object field of view at about the scale or size associated with a diffraction limited point or spot within the object field of view. Thus, a band-pass filtering of spatial frequencies in what is known as Fourier space or "k-space" is achieved such that the projected size (projection in a direction from the sensor toward object space) of the receptor is filled in k-space.
[0008] In other words, the image transfer medium is adapted, configured and/or selected such that a transform into k-space is achieved, wherein an a priori design determination causes k-space or band-pass frequencies of interest to be substantially preserved throughout and frequencies above and below the k-space frequencies to be mitigated. It is noted that the frequencies above and below the k-space frequencies tend to cause blurring and contrast reduction and are generally associated with conventional optical system designs which define intrinsic constraints on a Modulation Transfer Function and "optical noise". This further illustrates that the systems and methods of the present invention are in contravention or opposition to conventional geometric paraxial ray designs. Consequently, many known optical design limitations associated with conventional systems are mitigated by the present invention.
[0009] According to one aspect of the present invention, a "k-space" design, system and methodology is provided which defines a "unit-mapping" of the Modulation Transfer Function (MTF) of an object plane to image plane relationship. The k-space design projects image plane pixels or receptors forward to the object plane to promote an optimum theoretical relationship. This is defined by numeric ratios and sizes of projected image sensor receptors and projected object plane units (e.g., units defined by smallest resolvable points or spots in an optical or image transfer medium) that are matched according to the projected receptor size. The k-Space design defines "unit-mapping" or "unit-matching" acts as an effective "Intrinsic Spatial Filter" which implies that spectral components of both an object and an image in k-space (also referred to as "reciprocal-space") are substantially matched or quantized. Advantages provided by the k-space design result in a system and methodology capable of much higher effective resolved magnification with concomitantly related and much increased Field Of View, Depth Of Field, Absolute Spatial Resolution, and Working Distances utilizing dry objective lens imaging, for example, and without employing conventional oil immersion techniques having inherent intrinsic limitations to the aforementioned parameters.
[0010] One aspect of the present invention relates to an optical system that includes an optical sensor having an array of light receptors having a pixel size. A lens optically associated with the optical sensor is configured with optical parameters functionally related to the pixel size and a desired resolution of the optical system. As a result, the lens is operative to substantially map a portion of an object having the desired resolution along the optical path to an associated one of the light receptors.
[0011] Another aspect of the present invention relates to a method of designing an optical system. The method includes selecting a sensor with a plurality of light receptors having a pixel size and projected pixel size in the object plane. A desired minimum spot size resolution is selected for the system and a lens configured or an extant lens selected with optical parameters based on the projected pixel size and the desired minimum spot size is provided so as to map the plurality of light receptors to part of the image according to the desired resolution. The mapping can be quantified by ratios between projected pixel size and diffraction spot size.
[0012] The following description and the annexed drawings set forth in detail certain illustrative aspects of the invention. These aspects are indicative, however, of but a few of the various ways in which the principles of the invention may be employed and the present invention is intended to include all such aspects and their equivalents. Other advantages and novel features of the invention will become apparent from the following detailed description of the invention when considered in conjunction with the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
[0013] FIG. 1 is a schematic block diagram illustrating an imaging system in accordance with an aspect of the present invention.
[0014] FIG. 2 is a diagram illustrating a k-space system design in accordance with an aspect of the present invention.
[0015] FIG. 3 is a diagram of an exemplary system illustrating sensor receptor matching in accordance with an aspect of the present invention.
[0016] FIG. 4 is a graph illustrating sensor matching considerations in accordance with an aspect of the present invention.
[0017] FIG. 5 is a graph illustrating a Modulation Transfer Function in accordance with an aspect of the present invention.
[0018] FIG. 6 is a graph illustrating a figure of merit relating to a Spatial Field Number in accordance with an aspect of the present invention.
[0019] FIG. 7 is a flow diagram illustrating an imaging methodology in accordance with an aspect of the present invention.
[0020] FIG. 8 is a flow diagram illustrating a methodology for selecting optical parameters in accordance with an aspect of the present invention.
[0021] FIG. 9 is a schematic block diagram illustrating an exemplary imaging system in accordance with an aspect of the present invention.
[0022] FIG. 10 is a schematic block diagram illustrating a modular imaging system in accordance with an aspect of the present invention.
[0023] FIGS. 11-13 illustrate alternative imaging systems in accordance with an aspect of the present invention.
[0024] FIGS. 14-18 illustrate exemplary applications in accordance with the present invention.
[0025] FIG. 19 illustrates an automated inspection and/or manufacturing system and process in accordance with an aspect of the present invention.
[0026] FIG. 20 illustrates exemplary objects for inspection and/or manufacturing in accordance with an aspect of the present invention.
[0027] FIG. 21 illustrates exemplary particle, material, and/or component analysis in accordance with an aspect of the present invention.
[0028] FIGS. 22 and 23 illustrate correlative imaging techniques in accordance with an aspect of the present invention.
[0029] FIG. 24 illustrates a system for suspended particulate detection/imaging in gaseous, liquid, transmissive and/or solid mediums in accordance with an aspect of the present invention.
[0030] FIG. 25 is a top down view illustrating an exemplary sensor in accordance with an aspect of the present invention.
[0031] FIG. 26 is a cross sectional view illustrating an exemplary sensor in accordance with an aspect of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0032] The present invention relates to an optical and/or imaging system and methodology. According to one aspect of the present invention, a k-space filter is provided that can be configured from an image transfer medium such as optical media that correlates image sensor receptors to an optical or image transfer medium. A variety of illumination sources can also be employed to achieve one or more operational goals and for versatility of application. The k-space design of the imaging system of the present invention promotes capture and analysis (e.g., automated and/or manual) of images having a high Field Of View (FOV) at substantially high Effective Resolved Magnification as compared to conventional systems. This can include employing a small Numerical Aperture (NA) associated with lower magnification objective lenses to achieve very high Effective Resolved Magnification. As a consequence, images having a substantially large Depth Of Field (DOF) at very high Effective Resolved Magnification are also realized. The k-space design also facilitates employment of homogeneous illumination sources that are substantially insensitive to changes in position, thereby improving methods of examination and analysis.
[0033] According to another aspect of the present invention, an objective lens to object distance (e.g., Working Distance) can be maintained in operation at low and high power effective resolved magnification imaging, wherein typical spacing can be achieved at about 0.1 mm or more and about 20 mm or less, as opposed to conventional microscopic systems which can require significantly smaller (as small as 0.01 mm) object to objective lens distances for comparable (e.g., similar order of magnitude) Effective Resolved Magnification values. In another aspect, the Working Distance is about 0.5 mm or more and about 10 mm or less. It is to be appreciated that the present invention is not limited to operating at the above working distances. In many instances the above working distances are employed, however, in some instances, smaller or larger distances are employed. It is further noted that oil immersion or other Index of Refraction matching media or fluids for objective lenses are generally not required (e.g., substantially no improvement to be gained) at one or more effective image magnification levels of the present invention yet, still exceeding effective resolved magnification levels achievable in conventional microscopic optical design variations including systems employing "infinity-corrected" objective lenses.
[0034] The k-space design of the present invention defines that a small "Blur Circle" or diffraction limited point/spot at the object plane is determined by parameters of the design to match projected image sensor receptors or projected pixels in the object plane with a ratio defined correspondence by "unit-mapping" of object and image spaces for associated object and image fields. This enables the improved performance and capabilities of the present invention. One possible theory of the k-space design results from the mathematical concept that since the Fourier Transform of both an object and an image is formed in k-space (also called "reciprocal space"), the sensor is mapped to the object plane in k-space via optical design techniques and component placement in accordance with the present invention. It is to be appreciated that a plurality of other transforms or models can be utilized to configure and/or select one or more components in accordance with the present invention. For example, wavelet transforms, Laplace (s-transforms), z-transforms as well as other transforms can be similarly employed.
[0035] The k-space design methodology is unlike conventional optical systems designed according to geometric, paraxial ray-trace and optimization theory, since the k-space optimization facilitates that the spectral components of the object (e.g., tissue sample, particle, semiconductor) and the image are the same in k-space, and thus quantized. Therefore, there are substantially no inherent limitations imposed on a Modulation Transfer Function (MTF) describing contrast versus resolution and absolute spatial resolution in the present invention. Quantization, for example, in k-space yields a substantially unitary Modulation Transfer Function not realized by conventional systems. It is noted that high MTF, Spatial Resolution, and effective resolved image magnification can be achieved with much lower magnification objective lenses with desirable lower Numerical Apertures (e.g., generally less than about 50.times. with a numerical aperture of generally less than about 0.7) through "unit-mapping" of projected pixels in an "Intrinsic Spatial Filter" provided by the k-space design.
[0036] If desired, "infinity-corrected" objectives can be employed with associated optical component and illumination, as well as spectrum varying components, polarization varying components, and/or contrast or phase varying components. These components can be included in an optical path-length between an objective and the image lens within an "infinity space". Optical system accessories and variations can thus be positioned as interchangeable modules in this geometry. The k-space design, in contrast to conventional microscopic imagers that utilize "infinity-corrected" objectives, enables the maximum optimization of the infinity space geometry by the "unit-mapping" concept. This implies that there is generally no specific limit to the number of additional components that can be inserted in the "infinity space" geometry as in conventional microscopic systems that typically specify no more than 2
additional components without optical correction.
[0037] The present invention also enables a "base-module" design that can be configured and reconfigured in operation for a plurality of different applications if necessary to employ transmissive and/or reflected illumination, if desired. This includes substantially all typical machine vision illumination schemes (e.g., darkfield, brightfield, phase-contrast), and other microscopic transmissive techniques (Kohler, Abbe), in substantially any offset and can include Epi-illumination--and variants thereof. The systems of the present invention can be employed in a plurality of opto-mechanical designs that are robust since the k-space design is substantially not sensitive to environmental and mechanical vibration and thus generally does not require heavy structural mechanical design and isolation from vibration associated with conventional microscopic imaging instruments. Other features can include digital image processing, if desired, along with storage (e.g., local database, image data transmissions to remote computers for storage/analysis) and display of the images produced in accordance with the present invention (e.g., computer display, printer, film, and other output media). Remote signal processing of image data can be provided, along with communication and display of the image data via associated data packets that are communicated over a network or other medium, for example.
[0038] Moreover, images that are created in accordance with the present invention can be stored and/or transmitted with other digital information (e.g., audio data, other images, medical histories, product information, analysis information, and so forth). For example, an image may have associated voice-encoded data describing one or more aspects of the image or images contained as part of a data package that can be stored locally and/or transmitted across a network for remote storage and/or further analysis. In one specific example, an image created in accordance with the present invention can be transmitted to a remote location, wherein the image is further analyzed (e.g., medical or product specialist analyzes received image on a computer or image display). After analysis, a voice encoding or related data is appended or encoded with the received image and then transmitted back to the originating location (or other location), wherein the image and resultant encoded analysis can be reviewed. As can be appreciated, substantially any type of digital information can be stored and/or transmitted with images that are created in accordance with the present invention.
[0039] Also, as will be apparent from the following description, the present invention can be economically implemented in a plurality of various packages including integrated imaging/computing systems that are employed to analyze various samples. Such systems include handheld devices, notebook computers, laptops, personal digital assistants, and so forth that are adapted with the imaging concepts described herein.
[0040] Referring initially to FIG. 1, an imaging system 10 is illustrated in accordance with an aspect of the present invention. The imaging system 10 includes a sensor 20 having one or more receptors such as pixels or discrete light detectors (See e.g., illustrated below in FIG. 3) operably associated with an image transfer medium 30. The image transfer medium 30
is adapted or configured to scale the proportions of the sensor 20 at an image plane established by the position of the sensor 20 to an object field of view illustrated at reference numeral 34. A planar reference 36
of X and Y coordinates is provided to illustrate the scaling or reduction of the apparent or virtual size of the sensor 20 to the object field of view 34. Direction arrows 38 and 40 illustrate the direction of reduction of the apparent size of the sensor 20 toward the object field of view 34.
[0041] The object field of view 34 established by the image transfer medium 30 is related to the position of an object plane 42 that includes one or more items under microscopic examination (not shown). It is noted that the sensor 20 can be substantially any size, shape and/or technology (e.g., digital sensor, analog sensor, Charge Coupled Device (CCD) sensor, CMOS sensor, Charge Injection Device (CID) sensor, an array sensor, a linear scan sensor) including one or more receptors of various sizes and shapes, the one or more receptors being similarly sized or proportioned on a respective sensor to be responsive to light (e.g., visible, non-visible, "light", "radiation", or other such "visible" or "invisible" or "non-visible" hereafter meaning radiation of some desired wavelength optically directed. That is: radiation of any particular wavelength whose optical path, direction, and/or path length is altered by means of an optical medium, surface, material, component, or components, or other such means suitable to radiation of that wavelength in the configuration or configurations pertaining to the direction of such radiation to achieve the desired characteristics in accordance with the present invention) received from the items under examination in the object field of view 34.
[0042] As light is received from the object field of view 34, the sensor 20 provides an output 44 that can be directed to a local or remote storage such as a memory (not shown) and displayed from the memory via a computer and associated display, for example, without substantially any intervening digital processing (e.g., straight bit map from sensor memory to display), if desired. It is noted that local or remote signal processing of the image data received from the sensor 20 can also occur. For example, the output 44 can be converted to electronic data packets and transmitted to a remote system over a network and/or via wireless transmissions systems and protocols for further analysis and/or display. Similarly, the output 44 can be stored in a local computer memory before being transmitted to a subsequent computing system for further analysis and/or display.
[0043] The scaling provided by the image transfer medium 30 is determined by a novel k-space configuration or design within the medium that promotes predetermined k-space frequencies of interest and mitigates frequencies outside the predetermined frequencies. This has the effect of a band-pass filter of the spatial frequencies within the image transfer medium 30 and notably defines the imaging system 10 in terms of resolution rather than magnification. As will be described in more detail below, the resolution of the imaging system 10 determined by the k-space design promotes a plurality of features in a displayed or stored image such as having high effective resolved magnification, high absolute spatial resolution, large depth of field, larger working distances, and a unitary Modulation Transfer Function as well as other features.
[0044] In order to determine the k-space frequencies, a size or a "pitch" or spacing is determined between adjacent receptors on the sensor 20, the pitch related to the center-to-center distance of adjacent receptors and about the size or diameter of a single receptor. The pitch of the sensor 20 defines the Nyquist "cut-off" frequency band of the sensor. It is this frequency band that is promoted by the k-space design, whereas other frequencies are mitigated. In order to illustrate how scaling is determined in the imaging system 10, a small or diffraction limited spot or point 50 is illustrated at the object plane 42. The diffraction limited point 50 represents the smallest resolvable object determined by optical characteristics within the image transfer medium 30 and is described in more detail below. A scaled receptor 54, depicted in front of the field of view 34 for exemplary purposes, and having a size determined according to the pitch, for example, of the sensor 20, is matched or scaled to have a size ratio in the object field of view 34 as the diffraction limited point 50 which is a function of the resolvable characteristics of the image transfer medium 30.
[0045] In other words, the size of any given receptor at the sensor 20 is effectively reduced in size via the image transfer medium 30 to have a size (or matched in size) within a ratio of the size of the diffraction limited point 50. This also has the effect of filling the object field of view 34 with substantially all of the receptors of the sensor 20, the respective receptors being suitably scaled to be similar in size to the diffraction limited point 50. As will be described in more detail below, the matching/mapping of sensor characteristics to the smallest resolvable object or point within the object field of view 34 defines the imaging system 10 in terms of absolute spatial resolution and thus, enhances the operating performance of the system.
[0046] An illumination source 60 can be provided with the present invention in order that photons from the source can be transmitted through and/or reflected from objects in the field of view 34 to enable activation of the receptors in the sensor 20. It is noted that the present invention can potentially be employed without an illumination source 60 if potential self-luminous objects (e.g., fluorescent or phosphorescent biological or organic material sample, metallurgical, mineral, and/or other inorganic material and so forth) emit enough radiation to activate the sensor 60. Light Emitting Diodes, however, provide an effective illumination source 60 in accordance with the present invention. Substantially any illumination source 60 can be applied including coherent and non-coherent sources, visible and non-visible wavelengths. However, for non-visible wavelength sources, the sensor 20 and if necessary, the optical media of the image transfer medium 30 would also be suitably adapted. For example, for an infrared or ultraviolet source, an infrared or ultraviolet sensor 20 and IR or UV suitable optical components in the image transfer medium 30 would be employed, respectively. Other illumination sources 60 can include wavelength-specific lighting, broadband lighting, continuous lighting, strobed lighting, Kohler illumination, Abbe illumination, phase-contrast illumination, darkfield illumination, brightfield illumination, and Epi illumination. Transmissive or reflective lighting techniques (e.g., specular and diffuse) can also be applied.
[0047] Referring now to FIG. 2, a system 100 illustrates an image transfer medium in accordance with an aspect of the present invention. The image transfer medium 30 depicted in FIG. 1 can be provided according to the k-space design concepts described above and more particularly via a k-space filter 110 adapted, configured and/or selected to promote a band of predetermined k-space frequencies 114 and to mitigate frequencies outside of this band. This is achieved by, for example, determining a pitch "P"--which is the distance between adjacent receptors 116 in a sensor (not shown) and sizing optical media within the filter 110 such that the pitch "P" of the receptors 116 is matched in size with a diffraction-limited spot 120. other pixel size parameters may be employed. The diffraction-limited spot 120 can be determined from the optical characteristics of the media in the filter 110. For example, the Numerical Aperture of an optical medium such as a lens defines the smallest object or spot that can be resolved by the lens. The filter 110
performs a k-space transformation such that the size of the pixel is effectively matched, "unit-mapped", projected, correlated, and/or reduced to the size or scale of the diffraction limited spot 120, in accordance with ratios provided below.
[0048] It is to be appreciated that a plurality of optical configurations can be provided to achieve the k-space filter 110. One such configuration can be provided by an aspherical lens 124 adapted such to perform the k-space transformation and reduction from sensor space to object space. Yet another configuration can be provided by a multiple lens arrangement 128, wherein the lens combination is selected to provide the filtering and scaling. Still yet another configuration can employ a fiber optic taper 132 or image conduit, wherein multiple optical fibers or array of fibers are configured in a funnel-shape to perform the mapping of the sensor to the object field of view. It is noted that the fiber optic taper 132 is generally in physical contact between the sensor and the object under examination (e.g., contact with microscope slide). Another possible k-space filter 110 arrangement employs a holographic (or other diffractive or phase structure) optical element 136, wherein a substantially flat optical surface is configured via a hologram (or other diffractive or phase structure) (e.g., computer-generated, optically generated, and/or other method) to provide the mapping in accordance with the present invention.
[0049] The k-space optical design as enabled by the k-space filter 110 is based upon the "effective projected pixel size" of the sensor, which is a figure derived from following ("projecting") the physical size of the sensor array elements back through the optical system to the object plane. In this manner, conjugate planes and optical transform spaces are matched to the Nyquist cut-off of the effective receptor or pixel size. This maximizes the effective resolved image magnification and the Field Of View as well as the Depth Of Field and the Absolute Spatial Resolution. Thus, a novel application of optical theory is provided that does not rely on conventional geometric optical design parameters of paraxial ray-tracing which govern conventional optics and imaging combinations. This can further be described in the following manner.
[0050] A Fourier transform of an object and an image is formed (by an optical system) in k-space (also referred to as "reciprocal-space"). It is this transform that is operated on for image optimization by the k-space design of the present invention. For example, the optical media employed in the present invention can be designed with standard, relatively non-expensive "off-the-shelf" components having a configuration which defines that the object and image space are "unit-mapped" or "unit-matched" for substantially all image and object fields. A small Blur-circle or diffraction-limited spot 120 at the object plane is defined by the design to match the projected pixel sizes in the object plane with ratios described below and thus the Fourier transforms of pixelated arrays can be matched. This implies that, optically by design, the Blur-circle is scaled to the projected size of the receptor or to the projected pixel size. The present invention is defined such that it constructs an Intrinsic Spatial Filter such as the k-space filter 110. Such a design definition and implementation enables the spectral components of both the object and the image in k-space to be about the same or quantized. This also defines that the Modulation Transfer Function (MTF) (the comparison of contrast to spatial resolution) of the sensor is at least substantially matched to the MTF of the object Plane.
[0051] FIG. 3 illustrates an optical system 200 in accordance with an aspect of the present invention. The system 200 includes a sensor 212
having a plurality of receptors or sensor pixels 214. For example, the sensor 212 is an M by N array of sensor pixels 214, having M rows and N columns (e.g., 640.times.480, 512.times.512, 1280.times.1024, 2268.times.1536, 1420.times.1064, and so forth), M and N being integers respectively. Although a rectangular sensor 212 having generally square pixels is depicted, it is to be understood and appreciated that the sensor can be substantially any shape (e.g., circular, elliptical, hexagonal, rectangular, and so forth). It is to be further appreciated that respective pixels 214 within the array can also be substantially any shape or size, the pixels in any given array 212 being similarly sized and shaped in accordance with an aspect of the present invention.
[0052] The sensor 212 can be substantially any technology (e.g., digital sensor, analog sensor, Charge Coupled Device (CCD) sensor, CMOS sensor, Charge Injection Device (CID) sensor, an array sensor, a linear scan sensor) including one or more receptors (or pixels) 214. According to one aspect of the present invention, each of the pixels 214 is similarly sized or proportioned and responsive to light (e.g., visible, non-visible) received from the items under examination, as described herein.
[0053] The sensor 212 is associated with a lens network 216, which is configured based on performance requirements of the optical system and the pitch size of sensor 212. The lens network 216 is operative to scale (or project) proportions (e.g., pixels 214) of the sensor 212 at an image plane established by the position of the sensor 212 to an object field of view 220 in accordance with an aspect of the present invention. The object field of view 220 is related to the position of an object plane 222 that includes one or more items (not shown) under examination.
[0054] Departing from the specifics of FIG. 3, the most common pixel or photodetector shapes are squares and rectangles. However, the pixels can have any shape so long as it retains its function. Additional shapes of pixels include hexagons, octagons, and other polygons, circles, ovals, ellipses, and the like. The size of the pixels typically varies from sensor to sensor.
[0055] There are a number of ways in which to measure pixel size. Typically, when not specified otherwise, pixel size is represented by pixel pitch, which the distance between the centers of adjacent pixels. Pixel size can be represented by area (surface area of the top surface or light receiving/detecting surface of a pixel), pixel length, pixel width, pixel diameter, and the like. In the case of stacked pixels, pixel size is determined based on a stack to stack basis. If pixels in a stack are of different sizes, then either the average of the different sizes, the largest of the different sizes, or the smallest of the different sizes is used to determine pixel size. This is because, when compared to the diffraction limited spot size in the object plane, it is the projected pixel size in the object plane that is employed.
[0056] In one aspect of the invention, the pixel size is one of a pixel pitch (for any pixels), pixel length (for square pixels), and pixel width (for rectangular pixels), that is about 0.1 microns or more and about 20
microns or less. In another aspect of the invention, the pixel size is one of a pixel pitch (for any pixels), pixel length (for square pixels), and pixel width (for rectangular pixels), that is about 0.25 microns or more and about 15 microns or less. In yet another aspect of the invention, the pixel size is one of a pixel pitch (for any pixels), pixel length (for square or rectangular pixels), and pixel width (for square or rectangular pixels), that is about 0.5 microns or more and about 10
microns or less. In still yet another aspect of the invention, the pixel size is one of a pixel pitch (for any pixels), pixel length (for square or rectangular pixels), and pixel width (for square or rectangular pixels), that is about 4 microns or more and about 9 microns or less.
[0057] In one aspect of the invention, the pixel size is pixel area that is about 0.01 microns.sup.2 or more and about 600 microns or less. In another aspect of the invention, the pixel size is pixel area that is about 0.1 microns or more and about 200 microns.sup.2 or less. In yet another aspect of the invention, the pixel size is pixel area that is about 0.5 microns.sup.2 or more and about 100 microns.sup.2 or less. In still yet another aspect of the invention, the pixel size is pixel area that is about 1 microns or more and about 50 microns or less.
[0058] In one aspect of the invention, the projected pixel size in the object plane is one of a projected pixel pitch (for any pixels), projected pixel length (for square pixels), and projected pixel width (for rectangular pixels), that is about 0.01 microns or more and about 20
microns or less. In another aspect of the invention, the projected pixel size in the object plane is one of a projected pixel pitch (for any pixels), projected pixel length (for square pixels), and projected pixel width (for rectangular pixels), that is about 0.05 microns or more and about 15 microns or less. In yet another aspect of the invention, the projected pixel size in the object plane is one of a projected pixel pitch (for any pixels), projected pixel length (for square pixels), and projected pixel width (for rectangular pixels), that is about 0.1 microns or more and about 10 microns or less. In still yet another aspect of the invention, the projected pixel size in the object plane is one of a projected pixel pitch (for any pixels), projected pixel length (for square pixels), and projected pixel width (for rectangular pixels), that is about 0.5 microns or more and about 5 microns or less.
[0059] In one aspect of the invention, the projected pixel size is projected pixel area that is about 0.0003 microns.sup.2 or more and about 600 microns.sup.2 or less. In another aspect of the invention, the projected pixel size is projected pixel area that is about 0.001
microns.sup.2 or more and about 200 microns.sup.2 or less. In yet another aspect of the invention, the projected pixel size is projected pixel area that is about 0.01 microns or more and about 100 microns.sup.2 or less. In still yet another aspect of the invention, the projected pixel size is projected pixel area that is about 0.1 microns.sup.2 or more and about 50
microns.sup.2 or less.
[0060] Specific examples of pixel parameters include a pixel pitch, pixel length, pixel width, and/or pixel diameter of about 20 microns, about 12.5 microns, about 12 microns, about 11 microns, about 10.8 microns, about 10 microns, about 9.9 microns, about 9.12 microns, about 8.8
microns, about 7.9 microns, about 7.8 microns, about 7.4 microns, about 5.4 microns, about 5 microns, about 4 microns, about 3.5 microns, and about 2.7 microns.
[0061] The sensors may have pixels where substantially all pixels have substantially the same shape and/or size. The sensors may also have pixels where one subset of pixels has a first shape and/or first size and a second subset of pixels has a second shape and/or second size. That is, the sensors may have pixels of at least two different shapes and/or at least two different sizes. Sensors with different sized pixels may have pixels that have different sizes, or may have certain groups of pixels that are combined to make pixels of apparent different sizes. Of course, suitable control circuitry can be employed to use image data from discrete sets of pixels.
[0062] Referring to FIG. 25, a sensor 2500 is shown with four regions 2502, 2504, 2506, and 2508. Each of the four regions 2502, 2504, 2506, and 2508 has a discrete and different pixel size. That is, region 2502
has pixels 2510 of a first size and shape, region 2504 has pixels 2512 of a second size, region 2506 has pixels 2514 of a third size and second shape, region 2508 has pixels 2516 of a fourth size. Such a sensor can be employed in an imaging system that has a turret of four objective lenses, wherein each of the four objective lenses has a diffraction limited spot size in the object field of view matched with a respective one of the pixel sizes of the four pixel regions. The control circuitry can be employed to use data from a discrete set of pixels that have a size substantially matched with the size of the diffraction limited spot of one of the lenses.
[0063] The sensor may have a planar array of pixels where the pixels are oriented adjacent each other horizontally (unstacked), or an array of stacks of pixels may be provided on the sensor substrate. In the case of unstacked pixels, pixels having an ability to capture a discrete wavelength (or wavelength range) of light alternate throughout the sensor (to form, for example, a three colored checkerboard). In the case of stacked pixels (multilayered photodetectors), often three or four pixels are stacked, each having an ability to capture a discrete wavelength (or wavelength range) of light, such as red, green, and blue or cyan, magenta, and yellow in a three layered design and red, green, blue, and cyan in a four layered design. Also in the case of stacked pixels, each stack may contain pixels of the same size and/or shape or different sizes and/or shapes.
[0064] In embodiments where the sensor contains at least two arrays or areas having different pixel sizes, the arrays or areas may also be disposed so as to allow the direct indexing, or movement, or selection through optical path directing or mechanical directing, or other such means to configure any given discrete sensor array or area so that its entire discrete array or area or dimension is configured with the appropriate objective lens for mapping both the diffraction spot size to pixel size and the discrete sensor array or area to the entire object plane field of view in order to maximize the Absolute Spatial Resolution per pixel in the object plane. It is further defined that such groups, arrays, combinations, or other such assemblies comprising arrays of discrete sensor areas as described may be separated, individual sensor chips or integrated groupings on single substrates or mounts so disposed as to allow the selectability of the sensor group or array to be configured with the appropriate objective lens for mapping both the diffraction spot size to pixel size and the discrete sensor array or area to the object field of view. In other words, in order to maximize the Absolute Spatial Resolution of an image, the number of pixels projected within the object field of view is maximized, in addition to matching diffraction spot size in the object plane and pixel size.
[0065] Referring to FIG. 26, another sensor 2600 is shown having stacks 2602 of pixels. In this case, a stack 2602 of four pixels 2604, 2606, 2608, and 2610 (or four photodetectors that constitute a pixel stack 2602) is shown. When using a sensor having stacked pixels, the pixels or photodetectors of a stack may have the same or different sizes and/or shapes. FIG. 26 shows a stack 2602 having pixels 2604, 2606/2608, and 2610 having different sizes.
[0066] Examples of commercially available sensors, such as CCD and CMOS sensors, are those made by Foveon, Toshiba, Elisnet, Thomson, Sony, Samsung Semiconductor, Matsushita Electronics, Philips, Sharp, NEC, Motorola, Texas Instruments, EG&G Reticon, Kodak, Fairchild Imaging, CMOS Sensor Inc., Silicon Video Inc., National Semiconductor, Atmel, Exar, Agilent, Micron Technology, Mitsubishi, OmniVision, ST Microelectronics, and others.
[0067] Returning to FIG. 3, as the sensor 212 receives light from the object field of view 220, the sensor 212 provides an output 226 that can be directed to a local or remote storage such as a memory (not shown) and displayed from the memory via a computer and associated display, for example, without substantially any intervening digital processing (e.g., straight bit map from sensor memory to display), if desired. It is noted that local or remote signal processing of the image data received from the sensor 212 can also occur. For example, the output 226 can be converted to electronic data packets and transmitted to a remote system over a network for further analysis and/or display. Similarly, the output 226 can be stored in a local computer memory before being transmitted to a subsequent computing system for further analysis and/or display.
[0068] The scaling (or effective projecting) of pixels 214 provided by the lens network 216 is determined by a novel k-space configuration or design in accordance with an aspect of the present invention. The k-space design of the lens network 216 promotes predetermined k-space frequencies of interest and mitigates frequencies outside the predetermined frequency band. This has the effect of a band-pass filter of the spatial frequencies within the lens network 216 and notably defines the imaging system 200 in terms of resolution rather than magnification. As will be described below, the resolution of the imaging system 200 determined by the k-space design promotes a plurality of features in a displayed or stored image, such as having high "Effective Resolved Magnification" (a figure of merit described in following), with related high absolute spatial resolution, large depth of field, larger working distances, and a unitary Modulation Transfer Function as well as other features.
[0069] In order to determine the k-space frequencies, a pixel size is determined or a "pitch" or spacing 228 is determined between adjacent receptors 214 on the sensor 212. The pixel size (e.g., pixel pitch) can correspond to the center-to-center distance of adjacent receptors, indicated at 228, which is about the size or diameter of a single receptor when the sensor includes all equally sized pixels. The pitch 228
defines the Nyquist "cut-off" frequency band of the sensor 212. It is this frequency band that is promoted by the k-space design, whereas other frequencies are mitigated. In order to illustrate how scaling is determined in the imaging system 200, a point 230 of a desired smallest resolvable spot size is illustrated at the object plane 222, wherein the point is derived from resolvable characteristics of the lens network 216. The point 230, for example, can represent the smallest resolvable object determined by optical characteristics of the lens network 216. That is, the lens network is configured to have optical characteristics (e.g., magnification, numerical aperture) so that respective pixels 214 are matched or scaled to be within a ratio described below of the size in the object field of view 220 as the desired minimum resolvable spot size of the point 230. For purposes of illustration, a scaled receptor 232 is depicted in front of the field of view 220 as having a size determined according to the pitch 228 of the sensor 212, which is about the same as the point 230.
[0070] By way of illustration, the lens network 216 is designed to effectively reduce the size of each given receptor (e.g., pixel) 214 at the sensor 212 to be within the ratio (e.g., matched in size) of the size of the point 230, which is typically the minimum spot size resolvable by the system 210. It is to be understood and appreciated that the point 230
can be selected to a size representing the smallest resolvable object determined by optical characteristics within the lens network 216 as determined by diffraction rules (e.g., diffraction limited spot size). The lens network 216 thus can be designed to effectively scale each pixel 214 of the sensor 212 to any size that is equal to or greater than the diffraction limited size. For example, the resolvable spot size can be selected to provide for any desired image resolution that meets such criteria.
[0071] After the desired resolution (resolvable spot size) is selected, the lens network 216 is designed to provide the magnification to scale the pixels 214 to the object field of view 220 accordingly. This has the effect of filling the object field of view 220 with substantially all of the receptors of the sensor 212, the respective receptors being suitably scaled to be similar in size to the point 230, defined by ratios described below, which corresponds to the desired resolvable spot size. The matching/mapping of sensor characteristics to the desired (e.g., smallest) resolvable object or point 230 within the object field of view 220 defines the imaging system 200 in terms of absolute spatial resolution and enhances the operating performance of the system in accordance with an aspect of the present invention.
[0072] By way of further illustration, in order to provide unit-mapping according to this example, assume that the sensor array 212 provides a pixel pitch 228 of about 10 microns. The lens network 216 includes an objective lens 234 and a secondary lens 236. For example, the objective lens 234 can be set at infinite conjugate to the secondary lens 236, with the spacing between the objective and secondary lenses being flexible. The lenses 234 and 236 are related to each other so as to achieve a reduction from sensor space defined at the sensor array 220 to object space defined at the object plane 222. It is noted that substantially all of the pixels 214 are projected into the object field of view 220, which is defined by the objective lens 234. For example, the respective pixels 214 are scaled through the objective lens 234 to about the dimensions of the desired minimum resolvable spot size. In this example, the desired resolution at the image plane 222 is one micron. Thus, a magnification of ten times is operative to back project a ten micron pixel to the object plane 222 and reduce it to a size of one micron.
[0073] The reduction in size of the array 212 and associated pixels 214
can be achieved by selecting the transfer lens 236 to have a focal length "D2" (from the array 212 to the transfer lens 236) of about 150
millimeters and by selecting the objective lens to have a focal length "D1" (from the objective lens 236 to the object plane 222) of about 15
millimeters, for example. In this manner, the pixels 214 are effectively reduced in size to about 1 micron per pixel, thus matching the size of the of the desired resolvable spot 230 and filling the object field of view 220 with a "virtually-reduced" array of pixels. It is to be understood and appreciated that other arrangements of one or more lenses can be employed to provide the desired scaling.
[0074] In view of the foregoing description, those skilled in the art will understand and appreciate that the optical media (e.g., lens network 216) can be designed, in accordance with an aspect of the present invention, with standard, relatively inexpensive "off-the-shelf" components having a configuration that defines that the object and image space are "unit-mapped" or "unit-matched" for substantially all image and object fields. The lens network 216 and, in particular the objective lens 234, performs a Fourier transform of an object and an image in k-space (also referred to as "reciprocal-space"). It is this transform that is operated on for image optimization by the k-space design of the present invention.
[0075] A small Blur-circle or Airy disk at the object plane is defined by the design to match the projected pixels in the object plane within a certain ratio (size of projected pixel to size of the Airy disk) and thus the Fourier transforms of pixilated arrays can be matched. This implies that, optically by design, the Airy disk is scaled through the lens network 216 to be about the same size as the receptor or pixel size. As mentioned above, the lens network 216 is defined so as to construct an Intrinsic Spatial Filter (e.g., a k-space filter). Such a design definition and implementation enables the spectral components of both the object and the image in k-space to be about the same or quantized. This also defines that a Modulation Transfer Function (MTF) (the comparison of contrast to spatial resolution) of the sensor can be matched to the MTF of the object Plane in accordance with an aspect of the present invention.
[0076] A diffraction limited spot of an image transfer medium is the smallest resolvable object. The diffraction limited spot size is a parameter of an image transfer medium, such as a lens system. That is, the diffraction limited spot size varies from one lens to another. The diffraction limited spot is typically determined by the full width half maximum of the central peak of the gaussian diffraction spot. At least about 85% of the radiation energy exists in the central peak. Preferably, at least about 88% of the radiation energy exists in the central peak. Even more preferably, at least about 90% of the radiation energy exists in the central peak.
[0077] The diffraction limited spot size depends, in part, upon the wavelength of light used to capture an image. Any wavelength of light can be employed to form images in accordance with the invention. When using LEDs as an illumination source in the invention, it is possible to more narrowly provide light for capturing images. In one exemplary aspect of the invention, when an LED is employed to provide illumination, at least about 75% of the light energy has a wavelength range from about 100 nm to about 10,000 nm. In another exemplary aspect of the invention, at least about 75% of the light energy has a wavelength range from about 100 nm to about 400 nm. In yet another exemplary aspect of the invention, at least about 75% of the light energy has a wavelength range from about 400 nm to about 700 nm. In still yet another exemplary aspect of the invention, at least about 75% of the light energy has a wavelength range from about 700
nm to about 2,000 nm. In another exemplary aspect of the invention, at least about 75% of the light energy has a wavelength range from about 250
nm to about 500 nm. In another exemplary aspect of the invention, at least about 75% of the light energy has a wavelength range from about 500
nm to about 1,200 nm. In yet another exemplary aspect of the invention, at least about 75% of the light energy has a wavelength range from about 350 nm to about 1,000 nm.
[0078] A diffraction spot exists on an object side of the image transfer medium and on an image side of the image transfer medium. Generally speaking, when referring herein to diffraction limited spot or diffraction limited spot size, diffraction spot or diffraction spot size, it is the diffraction limited spot on the object side and in the object plane unless specified otherwise.
[0079] The diffraction limited spot shape is commonly a circle. However, the diffraction limited spot is determined by the physical dimensions and/or properties of the lens. The diffraction limited spot can have any shape so long as it retains its characteristic function. Additional shapes of diffraction spots include ovals, ellipses, hexagons, octagons, and other polygons, and the like. The size of the diffraction spot typically varies from image transfer medium to image transfer medium. For example, size of the diffraction spot typically varies from lens to lens.
[0080] There are a number of ways in which to measure diffraction limited spot size. Typically, when not specified otherwise, diffraction spot size is represented by diameter, which the cross-section through the centerpoint of a circle. Diffraction limited spot size can alternatively be represented by area. In the case of a lens train, diffraction spot size is determined based on the combination of lenses. In the case of an ellipse, the diameter refers to a line through the middle, perpendicular to the line that includes the two foci.
[0081] In one aspect of the invention, the diffraction spot (in the object plane) has a diameter of about 0.01 microns or more and about 20 microns or less. In another aspect of the invention, the diffraction spot has a diameter of about 0.05 microns or more and about 15 microns or less. In yet another aspect of the invention, the diffraction spot has a diameter of about 0.1 microns or more and about 10 microns or less. In still yet another aspect of the invention, the diffraction spot has a diameter of about 0.5 microns or more and about 5 microns or less.
[0082] In one aspect of the invention, the diffraction spot size is diffraction spot area that is about 0.0003 microns.sup.2 or more and about 600 microns.sup.2 or less. In another aspect of the invention, the diffraction spot size is diffraction spot area that is about 0.001
microns.sup.2 or more and about 200 microns.sup.2 or less. In yet another aspect of the invention, the diffraction spot size is diffraction spot area that is about 0.01 microns.sup.2 or more and about 100 microns.sup.2
or less. In still yet another aspect of the invention, the diffraction spot size is diffraction spot area that is about 0.1 microns.sup.2 or more and about 50 microns.sup.2 or less.
[0083] In another aspect of the invention, the image transfer medium has a diffraction limited spot in an image plane having a diameter of about 0.1
microns or more and about 20 microns or less, and/or an area that is about 0.01 microns.sup.2 or more and about 600 microns or less. In yet another aspect of the invention, the image transfer medium has a diffraction limited spot in an image plane having a diameter of about 0.25 microns or more and about 15 microns or less, and/or an area that is about 0.1 microns.sup.2 or more and about 200 microns or less.
[0084] Examples of commercially available image transfer media, such as lenses, are those made by Bausch & Lomb, Canon, edmund Optics, Fujinon, Kahles, Kowa, Leica, Minolta, Minox, Meiji, Melles Griot, Mitutoyo, Nikon, Olympus, Pentax, Prior, Steiner, Swarovski, Swift, Unitron, Wild, Zeiss, and others. Any type of lens may be employed, so long as the diffraction limited spot in the object plane is matched with the pixel size of the sensor. Examples of lenses that may be employed in the image transfer system include Plan_Neofluar, Plan Fluotar, Planapochromat, Plan, Achroplan, Epiplans, Achromat, Planachromats, Semiapochromatic, Apochromatic, Planapochromat, and the like.
[0085] As illustrated in FIG. 3, k-space is defined as the region between the objective lens 234 and the secondary lens 236. It is to be appreciated that substantially any optical media, lens type and/or lens combination that reduces, maps and/or projects the sensor array 212 to the object field of view 220 in accordance with unit or k-space mapping as described herein is within the scope of the present invention.
[0086] To illustrate the novelty of the exemplary lens/sensor combination depicted in FIG. 3, it is noted that conventional objective lenses, sized according to conventional geometric paraxial ray techniques, are generally sized according to the magnification, Numeric Aperture, focal length and other parameters provided by the objective. Thus, the objective lens would be sized with a greater focal length than subsequent lenses that approach or are closer to the sensor (or eyepiece in conventional microscope) in order to provide magnification of small objects. This can result in magnification of the small objects at the object plane being projected as a magnified image of the objects across "portions" of the sensor and results in known detail blur (e.g., Rayleigh diffraction and other limitations in the optics), empty magnification problems, and Nyquist aliasing among other problems at the sensor. The k-space design of the present invention operates in an alternative manner to conventional geometrical paraxial ray design principles. That is, the objective lens 234 and the secondary lens 236 operate to provide a reduction in size of the sensor array 212 to the object field of view 220, as demonstrated by the relationship of the lenses.
[0087] An illumination source 240 can be provided with the present invention in order that photons from that source can be transmitted through and/or reflected from objects in the field of view 234 to enable activation of the receptors in the sensor 212. It is noted that the present invention can potentially be employed without an illumination source 240 if potential self-luminous objects (e.g., objects or specimens with emissive characteristics as previously described) emit enough radiation to activate the sensor 212. Substantially any illumination source 240 can be applied including coherent and non-coherent sources, visible and non-visible wavelengths. However, for non-visible wavelength sources, the sensor 212 would also be suitably adapted. For example, for an infrared or ultraviolet source, an infrared or ultraviolet sensor 212
would be employed, respectively. Other suitable illumination sources 240
can include wavelength-specific lighting, broad-band lighting, continuous lighting, strobed lighting, Kohler illumination, Abbe illumination, phase-contrast illumination, darkfield illumination, brightfield illumination, Epi illumination, and the like. Transmissive or reflective (e.g., specular and diffuse) lighting techniques can also be applied.
[0088] FIG. 4 illustrates a graph 300 of mapping characteristics and comparison between projected pixel size on the X-axis and diffraction-limited spot resolution size "R" on the Y-axis. An apex 310
of the graph 300 corresponds to unit mapping between projected pixel size and the diffraction limited spot size, which represents an optimum relationship between a lens network and a sensor in accordance with the present invention.
[0089] It is to be appreciated that the objective lens 234 (FIG. 3) should generally not be selected such that the diffraction-limited size "R" of the smallest resolvable objects are substantially smaller than a projected pixel size. If so, "economic waste" can occur wherein more precise information is lost (e.g., selecting an object lens more expensive than required, such as having a higher numerical aperture). This is illustrated to the right of a dividing line 320 at reference 330
depicting a projected pixel 340 larger that two smaller diffraction spots 350. In contrast, where an objective is selected with diffraction-limited performance larger than the projected pixel size, blurring and empty magnification can occur. This is illustrated to the left of line 320 at reference numeral 360, wherein a projected pixel 370 is substantially smaller than a diffraction-limited object 380. It is to be appreciated, however, that even if substantially one-to-one correspondence is not achieved between projected pixel size and the diffraction-limited spot, a system can be configured with less than optimum matching (e.g., 0.1%, 1%, 2%, 5%, 20%, 95% down from the apex 310 on the graph 300 to the left or right of the line 320) and still provide suitable performance in accordance with an aspect of the present invention. Thus, less than optimal matching is intended to fall within the spirit and the scope of present invention.
[0090] It is further to be appreciated that the diameter of the lenses in the system as illustrated in FIG. 3, for example, should be sized such that when a Fourier Transform is performed from object space to sensor space, spatial frequencies of interest that are in the band pass region described above (e.g., frequencies utilized to define the size and shape of a pixel) are substantially not attenuated. This generally implies that larger diameter lenses (e.g., about 10 to 100 millimeters) should be selected to mitigate attenuation of the spatial frequencies of interest.
[0091] The projected pixel size of the sensor in the object plane and the diffraction limited spot size in the object plane of the image transfer medium are substantially matched or unit-mapped to provide at least one of improved absolute spatial resolution, improved depth of field, improved contrast, and improved field of view over digital images manufactured by a system where the pixel size of the sensor and the diffraction limited spot size in the object plane of the image transfer medium are not substantially matched or unit-mapped.
[0092] Matched or unit-mapped projected pixels and diffraction limited spots means that both the projected pixel area and diffraction limited spot size area in the object plane are about 0.0003 microns.sup.2 or more and about 600 microns.sup.2 or less. Alternatively or additionally, both the projected pixel projected pitch, projected pixel width, projected pixel length, or projected pixel diameter in the object plane and diffraction limited spot diameter in the object plane are about 0.01
microns or more and about 20 microns or less. The projected pixel size and the diffraction spot size determined by any measurement are suitably matched or unit-mapped to provide resolved images with generous field of view and depth of field.
[0093] In one aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is between 1:2 and 2:1. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is from about 1:1.9 to about 1.9:1. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is from about 1:1.7 to about 1.7:1. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is from about 1:1.5 to about 1.5:1. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is from about 1:1.4 to about 1.4:1. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is from about 1:1.3 to about 1.3:1. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is from about 1:1.2 to about 1.2:1. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by pitch, length, width, or diameter, is from about 1:1.1 to about 1.1:1.
[0094] In one aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 5:1 to about 1:12. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 4:1 to about 1:10. In yet another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 3.5:1 to about 1:8. In still yet another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 3:1 to about 1:6. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 2.5:1 to about 1:5. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 2:1 to about 1:4. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 1.5:1 to about 1:3. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 1.25:1 to about 1:2. In another aspect of the invention, the ratio of the projected pixel size to the diffraction spot size, both in the object plane and determined by area, is from about 1.1:1 to about 1:1.5.
[0095] Although not critical to the invention, in one aspect of the invention, the ratio of the pixel size to the diffraction limited spot in the image plane, both determined by pitch, length, width, or diameter, is from about 1:1.5 to about 1.5:1. In another aspect of the invention, the ratio of the pixel size to the diffraction limited spot in the image plane, both determined by pitch, length, width, or diameter, is from about 1:1.25 to about 1.25:1. In another aspect of the invention, the ratio of the pixel size to the diffraction limited spot in the image plane, both determined by pitch, length, width, or diameter, is from about 1:1.1 to about 1.1:1.
[0096] Referring now to FIG. 5, a Modulation Transfer function 400 is illustrated in accordance with the present invention. On a Y-axis, modulation percentage from 0 to 100% is illustrated defining percentage of contrast between black and white. On an X-axis, Absolution Spatial Resolution is illustrated in terms of microns of separation. A line 410
illustrates that modulation percentage remains substantially constant at about 100% over varying degrees of spatial resolution. Thus, the Modulation Transfer Function is about 1 for the present invention up to about a limit imposed by the signal to noise sensitivity of the sensor. For illustrative purposes, a conventional optics design Modulation Transfer Function is illustrated by line 420 which may be an exponential curve with generally asymptotic limits characterized by generally decreasing spatial resolution with decreasing modulation percentage (contrast).
[0097] FIG. 6 illustrates a quantifiable Figure of Merit (FOM) for the present invention defined as dependent on two primary factors: Absolute Spatial Resolution (RA, in microns), depicted on the Y axis and the Field Of View (F, in microns) depicted on the X axis of a graph 500. A reasonable FOM called "Spatial Field Number" (S), can be expressed as the ratio of these two previous quantities, with higher values of S being desirable for imaging as follows:
S=F/R.sub.A
[0098] A line 510 illustrates that the FOM remains substantially constant across the field of view and over different values of absolute spatial resolution which is an enhancement over conventional systems.
[0099] FIGS. 7, 8, 14, 15, 16, and 20 illustrate methodologies to facilitate imaging performance in accordance with the present invention. While, for purposes of simplicity of explanation, the methodologies may be shown and described as a series of acts, it is to be understood and appreciated that the present invention is not limited by the order of acts, as some acts may, in accordance with the present invention, occur in different orders and/or concurrently with other acts from that shown and described herein. For example, those skilled in the art will understand and appreciate that a methodology could alternatively be represented as a series of interrelated states or events, such as in a state diagram. Moreover, not all illustrated acts may be required to implement a methodology in accordance with the present invention.
[0100] Turning now to FIG. 7 and proceeding to 610, lenses are selected having diffraction-limited characteristics at about the same size of a pixel in order to provide unit-mapping and optimization of the k-space design. At 614, lens characteristics are also selected to mitigate reduction of spatial frequencies within k-space. As described above, this generally implies that larger diameter optics are selected in order to mitigate attenuation of desired k-space frequencies of interest. At 618, a lens configuration is selected such that pixels, having a pitch "P", at the image plane defined by the position of a sensor are scaled according to the pitch to an object field of view at about the size of a diffraction-limited spot (e.g., unit-mapped) within the object field of view. At 622, an image is generated by outputting data from a sensor for real-time monitoring and/or storing the data in memory for direct display to a computer display and/or subsequent local or remote image processing and/or analysis within the memory.
[0101] FIG. 8 illustrates a methodology that can be employed to design an optical/imaging system in accordance with an aspect of the present invention. The methodology begins at 700 in which a suitable sensor array is chosen for the system. The sensor array includes a matrix of receptor pixels having a known pitch size, usually defined by the manufacturer. The sensor can be substantially any shape (e.g., rectangular, circular, square, triangular, and so forth). By way of illustration, assume that a sensor of 640.times.480 pixels having a pitch size of 10 .mu.m is chosen. It is to be understood and appreciated that an optical system can be designed for any type and/or size of sensor array in accordance with an aspect of the present invention.
[0102] Next at 710, an image resolution is defined. The image resolution corresponds to the smallest desired resolvable spot size at the image plane. The image resolution can be defined based on the application(s) for which the optical system is being designed, such as any resolution that is greater than or equal to a smallest diffraction limited size. Thus, it is to be appreciated that resolution becomes a selectable design parameter that can be tailored to provide desired image resolution for virtually any type of application. In contrast, most conventional systems tend to limit resolution according to Rayleigh diffraction, which provides that intrinsic spatial resolution of the lenses cannot exceed limits of diffraction for a given wavelength.
[0103] After selecting a desired resolution (710), a suitable amount of magnification is determined at 720 to achieve such resolution. For example, the magnification is functionally related to the pixel pitch of the sensor array and the smallest resolvable spot size. The magnification (M) can be expressed as follows: 1 M = x y Eq . 1
[0104] wherein:
[0105] x is the pixel size such as pixel pitch of the sensor array; and
[0106] y is the desired image resolution (minimum spot size).
[0107] So, for the above example where the pixel pitch is 10 .mu.m and assuming a desired image resolution of 1 .mu.m, Eq. 1 provides an optical system of power ten. That is, the lens system is configured to back-project each 10 .mu.m pixel to the object plane and reduce respective pixels to the resolvable spot size of 1 micron.
[0108] The methodology of FIG. 8 also includes a determination of a Numerical Aperture at 730. The Numerical Aperture (NA) is determined according to well-established diffraction rules that relate NA of the objective lens to the minimum resolvable spot size determined at 710 for the optical system. By way of example, the calculation of NA can be based on the following equation: 2 NA = 0.5 .times. y Eq . 2
[0109] where:
[0110] .lambda.is the wavelength of light being used in the optical system; and
[0111] y is the minimum spot size (e.g., determined at 710).
[0112] Continuing with the example in which the optical system has a resolved spot size of y=1 micron, and assuming a wavelength of about 500
nm (e.g., green light), a NA=0.25 satisfies Eq. 2. It is noted that relatively inexpensive commercially available objectives of power 10
provide numerical apertures of 0.25.
[0113] It is to be understood and appreciated that the relationship between NA, wavelength and resolution represented by Eq. 2 can be expressed in different ways according to various factors that account for the behavior of objectives and condensers. Thus, the determination at 730, in accordance with an aspect of the present invention, is not limited to any particular equation but instead simply obeys known general physical laws in which NA is functionally related to the wavelength and resolution. After the lens parameters have been designed according to the selected sensor (700), the corresponding optical components can be arranged to provide an optical system (740) in accordance with an aspect of the present invention.
[0114] Assume, for purposes of illustration, that the example optical system created according to the methodology of FIG. 8 is to be employed for microscopic-digital imaging. By way of comparison, in classical microscopy, in order to image and resolve structures of a size approaching 1 micron (and below), magnifications of many hundreds usually are required. The basic reason for this is that such optics conventionally have been designed for the situation when the sensor of choice is the human eye. In contrast, the methodology of FIG. 8 designs the optical system in view of the sensor, which affords significant performance increases at reduced cost.
[0115] In the k-space design methodology, according to an aspect of the present invention, the optical system is designed around a discrete sensor that has known fixed dimensions. As a result, the methodology can provide a far more straight-forward, robust, and inexpensive optical system design approach to "back-project" the sensor size onto the object plane and calculate a magnification factor. A second part of the methodology facilitates that the optics that provide the magnification have a sufficient NA to optically resolve a spot of similar dimensions as the back-projected pixel. Advantageously, an optical system designed in accordance with an aspect of the present invention can utilize custom and/or off-the-shelf components. Thus, for this example, inexpensive optics can be employed in accordance with an aspect of the present invention to obtain suitable results, but well-corrected microscope optics are relatively inexpensive. If custom-designed optics are utilized, in accordance with an aspect of the present invention, then the range of permissible magnifications and numerical apertures becomes substantial, and some performance gains can be realized over the use of off-the-shelf optical components.
[0116] In view of the concepts described above in relation to FIGS. 1-8, a plurality of related imaging applications can be enabled and enhanced by the present invention. For example, these applications can include but are not limited to imaging, control, inspection, microscopy and/or other automated analysis such as:
[0117] (1) Bio-medical analysis (e.g., cell colony counting, histology, frozen sections, cellular cytology, Meachanical, Laser or radiation-based, and other Micro-dissection, Haematology, pathology, oncology, fluorescence, interference, phase and many other clinical microscopy applications);
[0118] (2) Particle Sizing Applications (e.g., Pharmaceutical manufacturers, paint manufacturers, cosmetics manufacturers, food process engineering, and others);
[0119] (3) Air quality monitoring and airborne particulate measurement (e.g., clean room certification, environmental certification, and so forth);
[0120] (4) Optical defect analysis, and other requirements for high resolution microscopic inspection of both transmissive and opaque materials (as in metallurgy, automated semiconductor inspection and analysis, automated vision systems, 3-D imaging and so forth); and
[0121] (5) Imaging technologies such as cameras, copiers, FAX machines and medical systems as well as other technologies/applications which are described in more detail below.
[0122] FIGS. 9, 10, 11, 12, and 13 illustrate possible example systems that can be constructed employing the concepts previously described above in relation to FIGS. 1-8. FIG. 9 is a flow diagram of light paths in an imaging system 800 adapted in accordance with the present invention.
[0123] The system 800 employs a light source 804 emitting illuminating light that is received by a light condenser 808. Output from the light condenser 808 is directed to a microscope condenser 816 (such output from 808 also can be directed by a fold mirror, or other component or components that redirect the optical path, as shown at 812) that projects illuminating light onto a slide stage 820, wherein an object (not shown, positioned on top of, or within the slide stage and the Field Volume Depth at the object plane) can be imaged in accordance with the present invention. The slide stage 820 can be automatically positioned (and/or manually) via a computer 824 and associated slide feed 828 in order to image one or more objects in a field of view defined by an objective lens 832. It is noted that the objective lens 832 and/or other components depicted in the system 800 may be adjusted manually and/or automatically via the computer 824 and associated controls (not shown) (e.g., servo motors, tube slides, linear and/or rotary position encoders, optical, magnetic, electronic, or other feedback mechanisms, control software, and so forth) to achieve different and/or desired image characteristics (e.g., magnification, focus, which objects appear in field of view, depth of field and so forth).
[0124] Light output from the objective lens 832 can be directed through an optional beam splitter 840, wherein the beam splitter 840 is operative with an alternative epi-illumination section 842 (to light objects from above slide stage 820) including light shaping optics 844 and associated light source 848. Light passing through the beam splitter 840 is received by an image forming lens 850. Output from the image forming lens 850 is directed to a CCD or other imaging sensor or device 854. It is shown that the output of 850 can also be directed to device 854 via a fold mirror 860, or other component or components that redirect the optical path as desired. The CCD or other imaging sensor or device 854 converts the light received from the object to digital information for transmission to the computer 824, wherein the object image can be displayed to a user in real-time and/or stored in memory at 864. As noted above, the digital information defining the image captured by the CCD or other imaging sensor or device 854 can be routed as bit-map information to the display/memory 864 by the computer 824. It is to be appreciated that "display" can be any of, but not limited to any type of computer monitor, CRT, LCD, TV, organic light emitting device display (OLED), or other semi-conductor image display device; miniature or any other type large or small-scale display projector, head-mount, flexible, monocular, binocular, or projection display, retinal display, Head-Up display, and others of the like. If desired, image processing such as automatic comparisons with predetermined samples or images can be performed to determine an identity of and/or analyze the object under examination. This can also include employment of substantially any type of image processing technology or software that can be applied to the captured image data within the memory 864.
[0125] FIG. 10 is a system 900 depicting an exemplary modular approach to imaging design in accordance with an aspect of the present invention. The system 900 can be based on a sensor array 910 (e.g., provided in off-the-shelf camera) with a pixel pitch of approximately 8 microns (or other dimension), for example, wherein array sizes can vary from 640.times.480 to 1280.times.1024 (or other dimensions as noted above as currently extant products or any other such arrays as might become available.). The system 900 includes a modular design wherein a respective module is substantially isolated from another module, thus, mitigating alignment tolerances.
[0126] The modules can include:
[0127] a camera/sensor module, 914 including an image-forming lens 916
and/or fold mirror 918;
[0128] an epi-illumination module 920 for insertion into a k-space region 922;
[0129] a sample holding and presentation module 924;
[0130] a light-shaping module 930 including a condenser 934; and
[0131] a sub-stage lighting module 940.
[0132] It is noted that the system 900 can advantageously employ commercially-available components such as for example:
[0133] condenser optics 934 (NA<=1) for the light presentation;
[0134] (e.g., Olympus U-SC-2)
[0135] standard plan/achromatic objective lenses or any other available or custom optical design and characteristic transmissive, reflective, or other optical path directive components 944 of power and numerical aperture e.g.,: (4.times., 0-10), (10.times., 0-25), (20.times., 0-40), (40.times., 0-65) selected to satisfy the desired characteristic that for a given magnification, the projected pixel-pitch at the object plane is similar in dimensions to the diffraction-limited resolved spot of the optics.
[0136] (e.g., Olympus 1-UB222, 1-UB223, 1-UB225, 1-UB227)
[0137] The system 900 utilizes an infinity-space (k-space) between the objective lens 944 and the image-forming lens 916 in order to facilitate the insertion of auxiliary and/or additional optical components, modules, filters, and so forth in the k-space region at 922 such as for example, when the image-forming lens 916 is adapted as an f=150 mm achromatic triplet. Furthermore, an infinity-space (k-space) between the objective lens 944 and the image-forming lens 916 can be provided in order to facilitate the injection of object illumination light (via a light-forming path) into an optical path for epi-illumination. For example, the light-forming path for epi-illumination can include:
[0138] a light source 950 such as an LED driven from a current-stabilised supply;
[0139] (e.g., HP HLMP-CW30)
[0140] a transmission hologram for source homogenisation and the imposition of a spatial virtual-source at 950;
[0141] (e.g., POC light shaping diffuser polyester film 30-degree FWHM)
[0142] a variable aperture at 960 to restrict the NA of the source 950 to that of the imaging optics, thereby mitigating the effect of scattered light entering the image-forming optical path;
[0143] (e.g., Thorlabs iris diaphragm SM1D12 0-5-12-0 mm aperture)
[0144] a collection lens at 960 employed to maximize the light gathered from the virtual source 950, and to match the k-space characteristics of the source to that of the imaging optics; and
[0145] (e.g., f=50 mm aspheric lens, f=50 mm achromatic doublet)
[0146] a partially-reflective beam splitter 964 employed to form a coaxial light path and image path. For example, the optic 964 provides a 50% reflectivity on a first surface (at an inclination of 45 degrees), and is broadband antireflection coated on a second surface.
[0147] The sub-stage lighting module 940 is provided by an arrangement that is substantially similar to that of the epi-illumination described above for example:
[0148] a light source 970 (an LED driven from a current-stabilised supply);
[0149] (e.g., HP HLMP-CW30)
[0150] a transmission hologram (associated with light source 970) for the purposes of source homogenisation and the imposition of a spatial virtual-source;
[0151] (e.g., POC light shaping diffuser polyester film 30-degree FWHM)
[0152] a collection lens 974 employed to maximize the light gathered from the virtual source 970, and to match the k-space characteristics of the source to that of the imaging optics;
[0153] (e.g., f=50 mm aspheric lens, f=50 mm achromatic doublet)
[0154] a variable aperture 980 to restrict the NA of the source 970 to that of the imaging optics, thereby mitigating the effect of scattered light entering the image-forming optical path;
[0155] (e.g., Thorlabs iris diaphragm SM1D12 0-5-12-0 mm aperture)
[0156] a mirror 988 utilized to turn the optical path through 90 degrees and provide fine-adjustment in order to accurately align the optical modules, though it will be appreciated that the described optical path length "turn" is not required for such alignment but facilitates such alignment by mitigating mechanical and tolerancing errors; and
[0157] a relay lens (not shown) employed to accurately position the image of the variable aperture 980 onto the object plane (at slide 990), thereby, along with suitable placement of a holographic diffuser, thus, achieving Kohler illumination.
[0158] (e.g., f=100 mm simple piano-convex lens).
[0159] As described above, a computer 994 and associated display/memory 998 is provided to display in real-time and/or store/process digital image data captured in accordance with the present invention.
[0160] FIG. 11 illustrates a system 1000 in accordance with an aspect of the present invention. In this aspect, a sub-stage lighting module 1010
(e.g., Kohler, Abbe) can project light through a transmissive slide 1020
(object under examination not shown), wherein an achromatic objective lens 1030 receives light from the slide and directs the light to an image capture module at 1040. It is noted that the achromatic objective lens 1030 and/or slide 1020 can be manually and/or automatically controlled to position the object(s) under examination and/or position the objective lens.
[0161] FIG. 12 illustrates a system 1100 in accordance with an aspect of the present invention. In this aspect, a top-stage or epi-illumination lighting module 1110 can project light to illuminate transmissive or opaque objects on an appropriately transmissive or opaque slide or carrier or suitable mounting substrates 120 (object under examination not shown), wherein an objective lens 1130 (can be compound lens device or other type) receives light from the slide and directs the light to an image capture module at 1140. As noted above, the objective lens 1130
and/or slide 1120 can be manually and/or automatically controlled to position the object(s) under examination and/or position the objective lens. FIG. 13 depicts a system 1200 that is similar to the system 1000 in FIG. 11 except that a compound objective lens 1210 is employed in place of an achromatic objective lens.
[0162] The imaging systems and processes described above in connection with FIGS. 1-13 may thus be employed to capture/process an image of a sample, wherein the imaging systems are coupled to a processor or computer that reads the image generated by the imaging systems and compares the image to a variety of images in an on-board data store in any number of current memory technologies.
[0163] For example, the computer can include an analysis component to perform the comparison. Some of the many algorithms employed in image processing include, but are not limited to convolution (on which many others are based), FFT, DCT, thinning (or skeletonization), edge detection and contrast enhancement. These are usually implemented in software but may also use special purpose hardware for speed. FFT (fast Fourier transform) is an algorithm for computing the Fourier transform of a set of discrete data values. Given a finite set of data points, for example, a periodic sampling taken from a real-world signal, the FFT expresses the data in terms of its component frequencies. It also addresses the essentially identical inverse concerns of reconstructing a signal from the frequency data. DCT (discrete cosine transform) is a technique for expressing a waveform as a weighted sum of cosines. There are a various extant programming languages designed for image processing which include but are not limited to those such as IDL, Image Pro, Matlab, and many others. There are also no specific limits to the special and custom image processing algorithms that may be written to perform functional image manipulations and analyses.
[0164] The k-space design of the present invention also allows for direct optical correlation of the Fourier Frequency information contained in the image with stored information to perform real-time optically correlated image processed analyses of a given sample object.
[0165] FIG. 14 illustrates a particle sizing application 1300 that can be employed with the systems and processes previously described. Particle sizing can include real-time, closed/open loop monitoring, manufacturing with, and control of particles in view of automatically determined particles sizes in accordance with the k-space design concepts previously described. This can include automated analysis and detection techniques for various particles having similar or different sizes (n different sizes, n being an integer) and particle identification of m-shaped/dimensioned particles, m being an integer). In one aspect of the present invention, desired particle size detection and analysis can be achieved via a direct measurement approach. This implies that the absolute spatial resolution per pixel relates directly (or substantially thereto) in units of linear measure to the imaged particles without substantial account of the particle medium and associated particle distribution. Direct measurement generally does not create a model but rather provides a metrology and morphology of the imaged particles in any given sample. This mitigates processing of modelling algorithms, statistical algorithms, and other modelling limitations presented by current technology. Thus, an issue becomes one of sample handling and form that enhances the accuracy and precision of measurements since the particle data is directly imaged and measured rather than modelled, if desired.
[0166] Proceeding to 1310 of the particle sizing application 1300, particle size image parameters are determined. For example, basic device design can be configured for imaging at desired Absolute Spatial Resolution per pixel and Effective Resolved Magnification as previously described. These parameters determine field of view (FOV), depth of field (DOF), and working distance (WD), for example. Real-time measurement can be achieved by either synchronous or asynchronous imaging of a medium at selected timing intervals, in real-time at common video rates, and/or at image capture rates as desired. Real-time imaging can also be achieved by capturing images at selected times for subsequent image processing. Asynchronous imaging can be achieved by capturing images at selected times by pulsing an instrument illumination at selected times and duty cycles for subsequent image processing.
[0167] At 1320, a sample introduction process is selected for automated (or manual) analysis. Samples can be introduced into an imaging device adapted in accordance with the present invention in any of the following (but not limited to) imaging processes:
[0168] 1) All previously described methods and transmissive media as well as:
[0169] 2) Individual manual samples in cuvettes, slides, and/or transmissive medium.
[0170] 3) Continuous flow of particles in stream of gas or liquid, for example.
[0171] 4) With an imaging device configured for epi-Illumination or other suitable reflective illumination imaging, samples may be opaque and presented on an appropriately transmissive or opaque "carrier" (automated and/or manual) without substantial regard to the material analyzed.
[0172] At 1330, a process control and/or monitoring system is configured. Real-time, closed loop and/or open loop monitoring, manufacturing with (e.g., closing loop around particle size), and control of processes by direct measurement of particle characteristics (e.g., size, shape, morphology, cross section, distribution, density, packing fraction, and other parameters can be automatically determined). It is to be appreciated that although direct measurement techniques are performed on a given particle sample, that automated algorithms and/or processing can also be applied to the imaged sample if desired. Moreover, a direct measurement-based particle characterization device can be installed at substantially any given point in a manufacturing process to monitor and communicate particle characteristics for process control, quality control, and so forth by direct measurement.
[0173] At 1340, a plurality of different sample types can be selected for analysis. For example, particle samples in any of the aforementioned forms can be introduced in continuous flow, periodic, and/or asynchronous processes for direct measurement in a device as part of a process closed-feedback-loop system to control, record, and/or communicate particle characteristics of a given sample type (can also include open loop techniques if desired). Asynchronous and/or synchronous techniques can be employed (the first defines imaging with a triggering signal sent by an event, or trigger signal initiated by an event or object generating a trigger signal to initiate imaging, the second defines imaging with a timing signal sent to trigger illumination independent of object location or presence).
[0174] Asynchronous and/or synchronous imaging can be achieved by pulsing an illumination source to coincide with the desired image field with substantially any particle flow rate. This can be controlled by a computer, for example, and/or by a "trigger" mechanism, either mechanical, optical, and/or electronic, to "flash" solid state illumination on and off with a given duty cycle so that the image sensor captures, displays and records the image for processing and analysis. This provides a straight-forward process of illuminating and imaging given that it effectively can be timed to "stop the action"- or rather, "freeze" the motion of the flowing particles in the medium. In addition, this enables that a sample within the image field to capture particles within the field for subsequent image processing and analysis.
[0175] It is to be appreciated that other adaptations and/or definitions for analyzing particles or materials can be provided. Rather than a synchronous vs. asynchronous configuration, other imaging aspects can include "continuous imaging" and/or "image-on-demand" techniques. Continuous imaging is generally employed with static objects and steady-state lighting, and image-on-demand for stop-flow techniques (e.g., moving particles/objects, Brownian motion, and so forth). Stop-flow imaging can be achieved by strobing a light source for a short time, or by shuttering a camera rapidly, for example, yielding several possibilities:
[0176] 1. Strobed illumination+long exposure camera.
[0177] 2. Continuous illumination+short exposure (shuttered) camera.
[0178] 3. Strobed illumination+synchronised shuttered camera.
[0179] As can be appreciated, the above examples can be made synchronous by reference to a suitable time base, or made asynchronous by demanding an image at an arbitrary time interval.
[0180] Real-time (or substantially real time), closed loop and/or open loop monitoring, manufacturing with, and control of processes by k-space-based, direct measurement of particle characterization at 1340 is applicable to a broad range of processes including (but not limited to): Ceramics, metal powders, pharmaceuticals, cement, minerals, ores, coatings, adhesives, pigments, dyes, carbon black, filter materials, explosives, food preparations, health & cosmetic emulsions, polymers, plastics, micelles, beverages--and many more particle-based substances requiring process manufacturing, monitoring and control.
[0181] Other applications include but are not limited to:
[0182] Instrument calibration and standards;
[0183] Industrial-hygiene research;
[0184] Materials research;
[0185] Energy and combustion studies;
[0186] Diesel- and gasoline-engine emissions measurements;
[0187] Industrial emissions sampling;
[0188] Basic aerosol research;
[0189] Environmental studies;
[0190] Bio-aerosol detection;
[0191] Including but not limited to biologic agent or contaminant such as spores, bacteria fungi, etc.
[0192] Pharmaceutical research;
[0193] Health and agricultural experiments;
[0194] Clean-Room Monitoring;
[0195] Inhalation toxicology; and/or
[0196] Filter testing.
[0197] At 1350, software and/or hardware based computerized image processing/analysis can occur. Images from a device adapted in accordance with the present invention can be processed in accordance with substantially any hardware and/or software process. Software-based image processing can be achieved by custom software and/or commercially available software since the image file formats are digital formats (e.g., bit maps, TIFF, JPEG, and so forth or any other digital image file format (or combinations thereof) of captured particles).
[0198] Analysis, characterization, and so forth can also be provided by the following: For example, analyses can be metrologic (direct measurement based), correlative, and/or comparative (database) based. Correlative and/or comparative analyses can include comparisons to a database of (but not lim