In recent years, the wine industry has been researching how to improve wine quality along the production value chain. In this scenario, we present here a new tool, MicroVi, a cost-effective chip-sized microscopy solution to detect and count yeast cells in wine samples. We demonstrate that this novel microscopy setup is able to measure the same type of samples as an optical microscopy system, but with smaller size equipment and with automated cell count configuration. The technology relies on the top of state-of-the-art computer vision pipelines to post-process the images and count the cells. A typical pipeline consists of normalization, feature extraction (i.e., SIFT), image composition (to increase both resolution and scanning area), holographic reconstruction and particle count (i.e., Hough transform). MicroVi achieved a 2.19 µm resolution by properly resolving the G7.6 features from the USAF Resolving Power Test Target 1951. Additionally, we aimed for a successful calibration of cell counts for Saccharomyces cerevisiae. We compared our direct results with our current optical setup, achieving a linear calibration for measurements ranging from 0.5 to 50 million cells per milliliter. Furthermore, other yeast cells were qualitatively resolved with our MicroVi microscope, such as, Brettanomyces bruxellensis, or bacteria, like, Lactobacillus plantarum, thus confirming the system’s reliability for consistent microbial assessment.
Nowadays, continuous monitoring is a difficult issue in microscopy. A chip-sized microscope was developed, composed only of microelectronic components, with high optical resolution and a wide field of view. Due to its miniaturized size, it can be placed on or attached to the sample for continuous monitoring in the sample environment. An example of an application of this microscope for the food and beverage industry is described, referring to the study of the fermentation process of white wine. The comparison of the images acquired with conventional optical microscopy reveals similar results. To automatically count yeast cells, the traditional image postprocessing is compared with deep learning. Neural networks achieve similar cell recognition characteristics but with an ~100× speed improvement, by directly processing the obtained holograms.
In technical courses with subjects that have high practical content, overexertion is common, resulting in students dropping out of the subject. Consequently, teachers propose teaching strategies to try to motivate the student and attract them to the subject. This paper details the experience of implementing a couple of Teaching Innovation Actions applied to the subject of Design and Synthesis of Digital Systems, which is taken during the 6th semester in the degree of Electronic Engineering and Telecommunications at the University of Barcelona.
Gamification is being incorporated into university classrooms due to its educational benefits for students learning, including encouraging student behavior and engagement, and consequently improving learning outcomes. Despite gamification being increasingly used in education, little has been developed related to Very-Large-Scale Integration (VLSI). In this article, we describe two different gamification experiences applied to integrated circuit processing and design in an introductory VLSI design course for Electronic Engineers. While gamification in universities is still not very mature and our experience spans only two academic years, we observed that, with the practice of gamifying part of our course, the topics treated in games were profoundly learned and the experience was very positive in every aspect of the teaching–learning process.
Digital histogram generation for time-resolved measurements with single-photon avalanche diode (SPAD) sensors requires the storage of many timestamp signals. This work presents a mixed-signal time-to-digital converter (TDC) that uses analog storage to achieve an area-efficient design that can be integrated in large SPAD arrays. Fabricated using a 150 nm CMOS process, the prototype occupies an area of only 18.3 µm × 36.5 µm, a notable size reduction compared to conventional designs. The experimental results demonstrated high performance, with an integral nonlinearity (INL) of 0.35/0.14 least significant bit (LSB) and a differential nonlinearity (DNL) of 0.14/−0.12 LSB. In addition, the proposed TDC can support the construction of histograms comprising up to 512 bins, making it an effective solution to accommodate a wide range of resolution requirements. Validated in a point-of-care (PoC) device for fluorescence lifetime measurements, it distinguished between lifetimes of approximately 4.1 ns, 3.6 ns and 80 ns with the Alexa Fluor (AF) 546 and 568 dyes and Quantum Dot (QD) 705, respectively. The analog storage design and area-efficient architecture offer a novel approach to integrating TDCs in SPAD-based systems, with potential applications in medical diagnostics and beyond.
A Point-of-Care system for molecular diagnosis (PoC-MD) is described, combining GaN and CMOS chips. The device is a micro-system for fluorescence measurements, capable of analyzing both intensity and lifetime. It consists of a hybrid micro-structure based on a 32 × 32 matrix addressable GaN microLED array, with square LEDs of 50 µm edge length and 100 µm pitch, with an underneath wire bonded custom chip integrating their drivers and placed face-to-face to an array of 16 × 16 single-photon avalanche diodes (SPADs) CMOS. This approach replaces instrumentation based on lasers, bulky optical components, and discrete electronics with a full hybrid micro-system, enabling measurements on 32 × 32 spots. The reported system is suitable for long lifetime (>10 ns) fluorophores with a limit of detection ~1/4 µM. Proof-of-concept measurements of streptavidin conjugate Qdot™ 605 and Amino PEG Qdot™ 705 are demonstrated, along with the device ability to detect both fluorophores in the same measurement.
GaN microLED technology has the potential to offer displays with high brightness, bandwidth, and long lifetime with a very low energy consumption. Moreover, GaN‐on‐Si hybrid interconnection technology allows the development of displays with a very high pixel density integration. In this work we present an in‐pixel driving circuit designed in a 0.18µm CMOS technology to be integrated on a 512x512 microLED array by using the KlettWelding hybrid interconnection technique forming a microLED display of 1411 ppi with 10kfps working speed. The pixel driver is able to achieve switching times of 1MHz and can be operated at high bias currents of 120µA. The individual driver consists of 4 SRAMs that apply a weighted current and allows to avoid the current stability problems associated to CMOS backplanes in hybridly interconnected displays.
The revolution of the GaN‐on‐Si hybrid integration has redefined microdisplay as a point‐light source for scientific, communication and visualization applications, thanks to their superior capabilities in terms of resolution, brightness and switching speed. In this work, we present a CMOS (Complementary Metal‐Oxide Semiconductor) backplane able to exploit the GaN microarrays capabilities, producing high‐speed patterns (up to 9.15 kfps) at high optical intensities (up to 120 uA per pixel and 16 grey levels) at an unprecedented resolution of 1411 PPI (512×512 pixel with 18um pitch). In addition, the backplane can be operated in pulsed mode, allowing the entire array to be toggled between the stored frame and off state at 1 MHz. Its unique characteristics expand the range of possible applications, from fluorescence‐based performance assays to the manufacturing of DNA chips.
The design study of a micro illumination tool based on GaN microLED arrays is presented. The high spatio-temporal resolution and the capability of generating fully customized optical patterns that characterize the proposed platform would enable the manipulation of biological systems, e.g., for optogenetics applications. Based on ray tracing simulations, the design aspects that mainly affect the device performance have been identified, and the related structural parameters have been optimized to improve the extraction efficiency and the spatial resolution of the resulting light patterns. Assuming that the device is a bottom emitter, and the light is extracted from the n-side, the presence of mesa-structures on the p-side of the GaN layer can affect both the efficiency and the resolution, being optimized for different values of the mesa-side inclination angle. The full width at half maximum (FWHM) of the extracted spots is mainly determined by the substrate thickness, and the relation between the FWHM and the array pitch represents a criterion to define the resolution. Namely, when F W H M<p i t c h, the spots are assumed to be resolved, while, when F W H M=p i t c h, a homogeneous distribution of light intensity is observed. The best performance is obtained when an in-GaN micro-lens array is included in the simulated structure, assuming that the substrate has been removed. The spatial resolution of the generated light pattern results as fully preserved, while the extraction efficiency in the best case is up to three times larger than that of a planar GaN/air interface.
GaN-on-Si based hybrid microdisplays have been the revolution as point-like light sources for scientific, communications, and imaging applications because of their high-resolution, high-brightness, and high-speed capabilities. Nevertheless, the microdisplay driving circuits usually focus only on two of these characteristics. In this work, we present a CMOS backplane that aims to exploit the capabilities of the GaN-based micro-arrays. The back panel can drive an array of GaN LED pixels of up to 512x512 of 1411 PPI (pixel per inch) with an in-pixel driver that offers a bias current up to 120 μA. The smart pixel control circuit has a 4-bit grayscale resolution. Frames can be updated at up to 10 kfps. Finally, the backplane can be operated in pulsed mode, toggling the entire array between the stored frame and off state at 1 MHz. The backplane design in 180 nm CMOS process and the in-pixel driver simulations results are presented.
GaN technology have been a revolutionary development in the light emitting sources field. Their high efficiency, high bandwidth, high lifetime and high integration capabilities has opened a brand-new research field. Furthermore, the integration of hybrid microdisplays based on GaN-on-Si allowed the development of high efficiency visible light communication devices and new branch of image applications among others. In this work, we present an in-pixel driving circuit with switching capabilities up to 1MHz and LED bias current up to 120µA. The pixel driver is designed to be integrated in a 512x512 microdisplay of 1411 ppi with 10kfps working capabilities. The in-pixel driver allows to eliminate the leakage problems of the conventional drivers for hybrid interconnexion, besides having high brightness and high-speed capabilities.
In this work we present a new microscope based on Nano-illumination microscopy (NIM), i.e., an innovative technique based on a 2D array of nano-Light-Emitting Diodes (LEDs) used to illuminate a sample. The key point of this method is that the pitch of the LED array fixes the spatial resolution. So, potentially, with LED pitches lower than the diffraction limit, super resolution could be achieved. While nanometer sized LEDs are not available yet, we present a prototype based on optical downscaling of a single 5µm lateral size LED. Extended Field-of-View (FOV) is obtained by mechanical movement with nanopositioners. Aspects of NIM microscopy such as its size, its flexibility in the sensing hardware or its potential for fluorescence, make it a perfect candidate to enhance emerging sensing applications in different fields, but especially life science (medical imaging, genomics, ...). We demonstrate the possibilities of the NIM technique with patterns as well as with biological samples.
Lensless microscopy requires the simplest possible configuration, as it uses only a light source, the sample and an image sensor. The smallest practical microscope is demonstrated here. In contrast to standard lensless microscopy, the object is located near the lighting source. Raster optical microscopy is applied by using a single-pixel detector and a microdisplay. Maximum resolution relies on reduced LED size and the position of the sample respect the microdisplay. Contrarily to other sort of digital lensless holographic microscopes, light backpropagation is not required to reconstruct the images of the sample. In a mm-high microscope, resolutions down to 800 nm have been demonstrated even when measuring with detectors as large as 138 μm × 138 μm, with field of view given by the display size. Dedicated technology would shorten measuring time.
GaN-based light emitting diodes (LEDs) have been shown to effectively operate down to nanoscale dimensions, which allows further downscaling the chip-based LED display technology from micro- to nanoscale. This brings up the question of what resolution limit of the illumination pattern can be obtained. We show two different approaches to achieve individually switchable nano-LED arrays. We evaluated both designs in terms of near-field spot size and optical crosstalk between neighboring pixels by using finite difference time domain (FDTD) simulations. The numerical results were compared with the performance data from a fabricated nano-LED array. The outcome underlines the influence of geometry of the LED array and materials used in contact lines on the final illumination spot size and shape.
Recent research into miniaturized illumination sources has prompted the development of alternative microscopy techniques. Although they are still being explored, emerging nano-light-emitting-diode (nano-LED) technologies show promise in approaching the optical resolution limit in a more feasible manner. This work presents the exploration of their capabilities with two different prototypes. In the first version, a resolution of less than 1 µm was shown thanks to a prototype based on an optically downscaled LED using an LED scanning transmission optical microscopy (STOM) technique. This research demonstrates how this technique can be used to improve STOM images by oversampling the acquisition. The second STOM-based microscope was fabricated with a 200 nm GaN LED. This demonstrates the possibilities for the miniaturization of on-chip-based microscopes.
MicroLED arrays with the capability of switching each pixel separately with high frequency can serve as structured micro-illumination light engines for applications in sensing, optogenetics, microscopy and many others. We describe a scalable chip process chain for the fabrication of passive-matrix microLED arrays, which were integrated with PCB-based driving electronics. The arrays were produced by deep-etching of conventional planar LED structures on sapphire, followed by filling and planarization steps. The pixel resolution lies in the range of 254 to 2540 pixels-per-inch (ppi), the arrays consist of 32 x 32 pixels. Optical output powers up to 50 µW per pixel were measured. In comparison to CMOS-based approaches, the presented technology is a simplified strategy to produce microLED arrays with high pixel counts.
The recent advances in chip-size microscopy based on optical scanning with spatially resolved nano-illumination light sources are presented. This new straightforward technique takes advantage of the currently achieved miniaturization of LEDs in fully addressable arrays. These nano-LEDs are used to scan the sample with a resolution comparable to the LED sizes, giving rise to chip-sized scanning optical microscopes without mechanical parts or optical accessories. The operation principle and the potential of this new kind of microscope are analyzed through three different implementations of decreasing LED dimensions from 20 µm down to 200 nm.
Nano-Illumination Microscopy (NIM) is a technique that provides compact microscopes but at the present time only setups with limited Field-of-View (FOV) have been presented. Existing NIM setups reconstruct the image by measuring the light intensity that passes through the specimen when switching after one another the light emitting diodes (LEDs) on an array. The resolution of NIM is related to the LEDs pitch, while the FOV to the total area covered by the array. The first prototypes were demonstrated with 10 μm-pitch GaN-based 8x8 LED arrays giving rise to 80x80 μm2 FOV. This work presents the first electronically-activated Scanning Transmission Optical Microscope (eSTOM) built with an Organic LED-on-silicon micro-display with 5 μm LEDs pitch, providing a FOV of 3.6 × 1.28 mm2 . It is combined with a CMOS optical sensor with no other optical or mechanical components. We demonstrate how downscaling of the OLED array by means of optical lenses allows to further reduce the size of the light sources to explore the technique in more detail. Here we show steps towards the utility of NIM as a practical, low-cost and compact microscopy technique for biophotonics and many other applications.
This work presents a compact low-cost and straightforward shadow imaging microscopy technique based on spatially resolved nano-illumination instead of spatially resolved detection. Independently addressable nano-LEDs on a regular 2D array provide the resolution of the microscope by illuminating the sample in contact with the LED array and creating a shadow image in a photodetector located on the opposite side. The microscope prototype presented here is composed by a GaN chip with an 8x8 array of 5μm-LEDs with 10 μm pitch light sources and a commercial CMOS image sensor with integrated lens used as a light collector. We describe the microscope prototype and analyze the effect of the sensing area size on image reconstruction.
A miniature internet of things (IoT)-based point-of-care testing (PoCT) fluorescence reader, able to perform both intensity and time-resolved measurements of different fluorescent tags, is presented. This low cost platform has been conceived for performing tests in low-resource and remote settings, displaying versatile performance and yet simple operation. It consists on an external case of 43 x 30 x 42 mm(3) (built in a 3D-printer) where all the elements are fixed, including some basic optics (3 lenses and 2 filters), a laser diode and a custom designed Single-Photon Avalanche Diodes (SPADs) camera. Both, the laser and the camera are controlled by a Field Programmable Gate Array (FPGA) with IoT capabilities. The PoCT was validated by detecting Plasmodium antigen in a fluorescent enzyme-linked immunosorbent assay (ELISA) using a fluorescence substrate. The results were compared to those provided in parallel by two commercial fluorescent plate readers. As it will be shown, the PoCT fluorescent readout was more sensitive than its colorimetric counterpart. Furthermore, the PoCT displayed similar signal trends and levels of detection than the bulkier and more expensive commercial fluorescence plate readers. These results demonstrate that the PoCT platform developed could bring the performance of central laboratory assay techniques closer to the end-user level.