Axelis Highest Energy Implaner Adopted by Image Sensor Manufacturer

...
PRNewswire: Axcelis announces that it has placed a Purion VXE, one of the new extended energy range models of Axcelis' high energy implanter range, at a leading chipmaker in Asia Pacific. The new system delivers the highest energy range in the Purion platform. The chipmaker plans to use the Purion VXE to support R&D for image sensors and next generation device development. The system will ship in Q1 2017.

Sometime ago, Axelis published a nice video explaining why high energy implanter is so important in modern image sensor manufacturing. Below is another video talking about Purion systems advantages for image sensor production:

12:18 PM

ON Semi Unveils MARS Platform

...
BusinessWire: ON Semiconductor introduces the Modular Automotive Reference System (MARS) that gives a ready-to-use camera for research and development activities. The MARS platform enables users to reconfigure cameras with different lenses, image sensors, ISPs and communications options for rapid prototyping and experimentation. The system can be used for the full spectrum of automotive camera applications including ADAS, surround and rear viewing systems, in-cabin cameras (for gesture recognition, driver eye monitoring, or light level inspection purposes), and autonomous driving.

MARS enables shorter design cycles, reduced engineering costs, and assists automotive design teams in the implementation of imaging systems by providing them with a unique mix-and-match solution. Through it, various items of hardware can be combined in a robust and highly adaptable system with a compact form-factor. Due to the many different boards available, engineers have access to ON Semiconductor’s broad portfolio of image sensors and co-processors, plus various automotive communications protocols from a select group of third party supply partners.


Update: The company has published a Youtube video explaining MARS platform features:

11:56 AM

Handling Document.UnknownCommand Event, 1 of 2

...
In one of my recent article (Custom On Demand Loading), I mentioned of handling Document.UnknownCommand could be used for on demand loading (last paragraph of that article). In my further dealing with UnknownCommand event, I also ran into an interesting issue. So, I decided to write down my experience on dealing with UnknownCommand to share with the community. I split the writing into 2 parts. This is the part 1: yet another on demand loading approach.

When thinking of loading application (DLLs, in the case of AutoCAD .NET add-in), the key is to find a suitable trigger moment when AutoCAD runs.When this trigger is pull off, a set of conditions/configurations should be examined to determine if particular applications/DLLs are already loaded in the AutoCAD process, and loaded them if necessary.

In my previous article, I wanted particular applications being loaded when the currently activated drawing is from specific project (project type, location, client... could be used as the criteria), then the trigger point is DocumentCollection.DocumentBecameCurrent event: the code would examine the drawing's project information to decide what applications should be available. Then if the applications have not been loaded, load them.

Now with handling Document.UnknownCommand we can have more generic on demand loading approach: whenever user enters a command from an application which has not been loaded, AutoCAD fires the UnknownCommand event. This allows our code in the event handler to use the unknown command name against a set of on demand loading configuration data to determine which applications are needed to be loaded. Here, we do not need to check if the application has already been loaded (otherwise, the UnknownCommand would not fire).

Here is a DLL project that is compiled as MyToolA.dll, in which 2 commands are defined:
using Autodesk.AutoCAD.Runtime;
using CadApp = Autodesk.AutoCAD.ApplicationServices.Application;

[assembly: CommandClass(typeof(MyToolA.Commands))]
[assembly: ExtensionApplication(typeof(MyToolA.Commands))]

namespace MyToolA
{
    public class Commands : IExtensionApplication
    {
        public void Initialize()
        {
            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;
            ed.WriteMessage(
                "\nLoading MyToolA.dll...done.\n");
        }

        public void Terminate()
        {
            
        }

        [CommandMethod("Command_A1")]
        public static void RunCommandA1()
        {
            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;

            ed.GetString(
                "\nThis \"Command_A1\" in DLL \"MyToolA.dll\"......" +
                "Press anykey to continue...");
            ed.WriteMessage("\n");
        }

        [CommandMethod("Command_A2")]
        public static void RunCommandA2()
        {
            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;

            ed.GetString(
                "\nThis \"Command_A2\" in DLL \"MyToolA.dll\"......" +
                "Press anykey to continue...");
            ed.WriteMessage("\n");
        }
    }
}

Then here is another DLL project. compiled as MyToolB.ll, in which another 2 commands are defined:
using Autodesk.AutoCAD.Runtime;
using CadApp = Autodesk.AutoCAD.ApplicationServices.Application;

[assembly: CommandClass(typeof(MyToolB.Commands))]
[assembly: ExtensionApplication(typeof(MyToolB.Commands))]

namespace MyToolB
{
    public class Commands : IExtensionApplication
    {
        public void Initialize()
        {
            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;
            ed.WriteMessage(
                "\nLoading MyToolB.dll is...done.\n");
        }

        public void Terminate()
        {

        }

        [CommandMethod("Command_B1")]
        public static void RunCommandA1()
        {
            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;

            ed.GetString(
                "\nThis \"Command_B1\" in DLL \"MyToolB.dll\"......" +
                "Press anykey to continue...");
            ed.WriteMessage("\n");
        }

        [CommandMethod("Command_B2")]
        public static void RunCommandA2()
        {
            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;

            ed.GetString(
                "\nThis \"Command_B2\" in DLL \"MyToolB.dll\"......" +
                "Press anykey to continue...");
            ed.WriteMessage("\n");
        }
    }
}

Now, I want these 2 DLLs to be loaded on demand, that is, when one of the commands defined in these 2 DLLs is called in AutoCAD, AutoCAD will load the DLL. So, I first came up with a simple set of auto-loading configuration, which is a Dictionary. That is, each Dictionary entry represents a DLL file name (entry's key) and an array of command names defined in the DLL (entry's value):
using System.Collections.Generic;

namespace HandlingUnknownCommand
{
    public class AutoLoaderSettings : Dictionary<string, string[]>
    {
        public string GetDllByCommandName(string cmdName)
        {
            foreach (var item in this)
            {
                var cmds = item.Value;
                foreach(var cmd in cmds)
                {
                    if (cmd.ToUpper() == cmdName.ToUpper()) return item.Key;
                }
            }

            return null;
        }

        // A static factory method to generate a set of test AutoLoaderSetting
        public static AutoLoaderSettings CreateTestSettings()
        {
            var settings = new AutoLoaderSettings();

            settings.Add(
                "MyToolA.dll",
                new string[] { "Command_A1", "Command_A2" });

            settings.Add(
                "MyToolB.dll",
                new string[] { "Command_B1", "Command_B2" });

            return settings;
        }
    }
}

Here comes the auto-loader:
using System.Reflection;

using Autodesk.AutoCAD.ApplicationServices;
using Autodesk.AutoCAD.Runtime;
using CadApp = Autodesk.AutoCAD.ApplicationServices.Application;

[assembly: CommandClass(typeof(HandlingUnknownCommand.MyAutoLoader))]
[assembly: ExtensionApplication(typeof(HandlingUnknownCommand.MyAutoLoader))]

namespace HandlingUnknownCommand
{
    public class MyAutoLoader : IExtensionApplication 
    {
        private static bool _autoLoad = false;
        private static AutoLoaderSettings _settings = 
            AutoLoaderSettings.CreateTestSettings();

        public void Initialize()
        {
            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;

            try
            {
                ed.WriteMessage("\nInitializing MyAutoLoader...");
                CadApp.DocumentManager.DocumentCreated += 
                    DocumentManager_DocumentCreated;
                foreach (Document doc in CadApp.DocumentManager)
                {
                    doc.UnknownCommand += Document_UnknownCommand;
                }
                _autoLoad = true;
                ed.WriteMessage("\nMyAutoLoader initialized successfully.");
            }
            catch(System.Exception ex)
            {
                _autoLoad = false;
                ed.WriteMessage(
                    "\nInitialzing MyAutoLoader failed:\n{0}\n", ex.Message);
            }
        }

        public void Terminate()
        {

        }

        private static void DocumentManager_DocumentCreated(
            object sender, DocumentCollectionEventArgs e)
        {
            e.Document.UnknownCommand += Document_UnknownCommand;
        }

        private static void Document_UnknownCommand(
            object sender, UnknownCommandEventArgs e)
        {
            if (!_autoLoad) return;

            var dwg = CadApp.DocumentManager.MdiActiveDocument;
            var ed = dwg.Editor;

            var cmdName = e.GlobalCommandName;
            var dllFileName = _settings.GetDllByCommandName(cmdName);
            if (!string.IsNullOrEmpty(dllFileName))
            {
                try
                {
                    LoadAssemblyDll(dllFileName);
                    ed.WriteMessage(
                        "\nDll {0} loaded, command {1} resuming...",
                        dllFileName.ToUpper(), cmdName.ToUpper());
                }
                catch (System.Exception ex)
                {
                    ed.WriteMessage(
                        "\nAutoloading DLL failed: {0}\n", ex.Message);
                }    
            }
        } 
        
        private static void LoadAssemblyDll(string dllFileName)
        {
            string path = System.IO.Path.GetDirectoryName(
                Assembly.GetExecutingAssembly().Location);
            string dll = path + "\\" + dllFileName;

            if (!ExtensionLoader.IsLoaded(dll))
            {
                if (System.IO.File.Exists(dll))
                {
                    ExtensionLoader.Load(dll);
                }
                else
                {
                    throw new System.IO.FileNotFoundException(
                        "Cannot find DLL file: " + dllFileName + "!");
                }
            }
        } 
    }
}


Now, see this video clip to see how the code runs.

As we can see, the 2 Dlls that actually define the commands are not preloaded, yet we can enter the commands and let the custom AutoLoader load the Dlls. Another interesting thing is that once the custom AutoLoader loads the Dlls according to configuration, AutoCAD automatically resumes the command (previously unknown whent eh command is issued, but becoming known after the Dll is loaded) execution. An extr message at command line is generated by AutoCAD. See the highlight in this picture:



AutoCAD's this behaviour indicates that if there is any UnknowCommand event handler other than .NET API's built-in one, AutoCAD will try the command again after the custom event handler execution. This allows us to make a command purely be loaded on demand and provide a good user experience: a not loaded command is loaded and executed without interruption, except for the extra line of message at command line. Well, there is a little catch: AutoCAD's auto-command-completion might be a bit annoying, if you have a custom command that similar to an existing AutoCAD command and you have to enter the custom command at command line.

Anyway. simply handling UnknownCommand event would allow us to build a custom Dll/command auto-loading process quite easily.

I'll be talking another interesting issue on handling UnknownCommand event in next post.

8:02 PM

MWC News

...
DPReview: Oppo announces 5.7mm-thin 5x optical zoom camera in its dual lens camera phone. Cnet reports it's based on Corephotonics technology:


EETimes-Europe: Occipital and Inuitive have jointly developed a structured light 3D sensing solution for mixed reality, augmented reality and virtual reality (MR/AR/VR) headsets and robotics. The solution merges Occipital’s Structure Core embeddable depth sensor with Inuitive’s NU3000 depth processing chip. The new solution is able to sense depths from 30cm to greater than 5m with an accuracy as high as ±0.17% RMS at 1m. System latency (from camera to fully-tracked pose) is just 10ms. EThe power consumption for depth + visible is between 1.3W and 2.0W, depending on the configuration selected.


Sony Xperia XZ Premium smartphone features the new 19MP 3-layer stacked image sensor with 960fps slow motion mode. Other than that, the phone features Predictive Hybrid Autofocus, minimized rolling shutter distortion, and 5-axis image stabilisation:




Sony Xperia Touch projector features an IR camera-based gesture recognition mimicking touch control:

12:56 PM

Nokia and SK Telecom to Commercialize Image Sensor-based Random Number Generator

...
PRNewswire: SK Telecom announces an agreement with Nokia to cooperate in the quantum cryptography business. Under the agreement, the two companies will cooperate in the area of Quantum Random Number Generator (QRNG), applying quantum cryptography technologies to IoT devices.

SK Telecom's QRNG is the world's smallest 5x5mm CMOS Image Sensor based all-in-one, single silicon providing non-deterministic true random numbers on demand from quantum-shot noise. SK Telecom plans to tape out engineering samples of QRNG chip in Q2 2017 and commercial launch is planned by the year end. SK Telecom envisions using QRNG for Internet of "secure" Things (IoT).

"Since opening Quantum Tech Lab in 2011, SK Telecom has been making constant efforts to develop quantum cryptography technologies," said Park Jung-ho, CEO and President of SK Telecom. "Based on the cooperation with Nokia, SK Telecom will create a new paradigm and ecosystem in the field of ICT."

"With SK Telecom's quantum cryptography technologies, we have secured the basis for building the most secure network security solution," said Rajeev Suri, CEO of Nokia. "We will respond proactively to rapidly growing demands of the cyber security market with these technologies and solutions."

Nokia and SK Telecom CEOs
11:11 AM

Brillnics Presents its First Products

...
Japan and Taiwan-based startup Brillnics unveils its first products for security and surveillance applications: two new 1/2.7” 1080p color BSI CMOS sensors: BRV0200 (60fps) and BRV0201 (120fps) utilizing Brillnics patented H³DRTM technology.

“We see customers expecting high imaging quality under extremely low light for various video applications. Collaborating with strategic foundry partner, Brillnics uses BSI technology featuring high sensitivity, high angular response, and low noise.”, said Dr. Shou-Gwo Wuu, CEO of Brillnics and former TSMC CIS group manager. “We are particularly excited about the introduction of single exposure HDR (SE HDR), which can significantly mitigate motion artifacts caused by moving objects. SE HDR allows the highest video fidelity in fast-moving scenes, such as in automotive applications.”

In comparison with most common HDR approaches, including a logarithmic response pixel, a linear-logarithmic response pixel, a dual photodiode pixel, or a multiple exposure HDR (ME HDR) scheme, Brillnics adopts the multiple exposure HDR scheme and/or single exposure HDR scheme. The SE HDR mode obtains two data from a same pixel. One is a lower response and the other a higher response, of which integration times are identical with no timing shift, unlike the ME HDR. Linearization using the two data is then performed on-chip, yielding 16bit digital signal or 12bit compressed digital signal.

The high dynamic range of the BRV0200/0201 in SE HDR mode is made possible by its very high low-light sensitivity and very high full well capacity. The very high low-light sensitivity comes from its high QE and low readout noise floor. Also, the very high full well capacity has been realized in the close collaboration with the strategic foundry partner.

Product Highlights:
  • Process: BSI
  • Pixel Size: 3.0 um
  • Optical Format: 1/2.7”
  • Angular Response: 85% @ ±20°
  • Max Frame Rate: 120fps, 12bit (BRV0201)
  • Hybrid Modes HDR: MEHDR/SEHDR
  • SE HDR: Dual conversion gain readout in single exposure time
  • SE HDR >85dB and ME HDR 120dB
  • SNRmax: 44dB
  • Power consumption: typ. 178mW at 60fps, 12bit

2:42 AM

Invisage Explains its 1.1um Pixel Global Shutter Operation

...
Invisage presented a paper "Device design for global shutter operation in a 1.1-μm pixel image sensor and its application to near infrared sensing" by Zach M. Beiley, Robin Cheung, Erin F. Hanelt, Emanuele Mandelli, Jet Meitzner, Jae Park, Andras Pattantyus-Abraham, and Edward H. Sargent at SPIE Physics and Simulation of Optoelectronic Devices XXV Conference held on Jan. 30-Feb. 2 in San Francisco.

The global shutter operation is based on QuantumFilm QE dependence on the bias voltage:

1:02 PM

Waymo Accuses Uber-acquired Otto in Stealing LiDAR Secrets

...
Bloomberg: It took Alphabet’s Waymo seven years to design and build a LiDAR for its self-driving cars. Uber-acquired Otto startup allegedly did it in nine months. Waymo claims in a lawsuit that its former employees stole the designs and technology and started a new company. Waymo says:

"One of the most powerful parts of our self-driving technology is our custom-built LiDAR — or “Light Detection and Ranging.” LiDAR is critical to detecting and measuring the shape, speed and movement of objects like cyclists, vehicles and pedestrians.

Hundreds of Waymo engineers have spent thousands of hours, and our company has invested millions of dollars to design a highly specialized and unique LiDAR system. Waymo engineers have driven down the cost of LiDAR dramatically even as we’ve improved the quality and reliability of its performance. The configuration and specifications of our LiDAR sensors are unique to Waymo. Misappropriating this technology is akin to stealing a secret recipe from a beverage company.

In 2016, Uber bought a six-month old startup called Otto and appointed its founder (a former employee on our self-driving car project) as its head of self-driving technology. At the time, it was reported that Otto’s LiDAR sensor was one of the key reasons Uber acquired the company.

Recently, we received an unexpected email. One of our suppliers specializing in LiDAR components sent us an attachment (apparently inadvertently) of machine drawings of what was purported to be Uber’s LiDAR circuit board — except its design bore a striking resemblance to Waymo’s unique LiDAR design.

We found that six weeks before his resignation this former employee, Anthony Levandowski, downloaded over 14,000 highly confidential and proprietary design files for Waymo’s various hardware systems, including designs of Waymo’s LiDAR and circuit board. To gain access to Waymo’s design server, Mr. Levandowski searched for and installed specialized software onto his company-issued laptop. Once inside, he downloaded 9.7 GB of Waymo’s highly confidential files and trade secrets, including blueprints, design files and testing documentation. Then he connected an external drive to the laptop. Mr. Levandowski then wiped and reformatted the laptop in an attempt to erase forensic fingerprints.

Beyond Mr. Levandowki’s actions, we discovered that other former Waymo employees, now at Otto and Uber, downloaded additional highly confidential information pertaining to our custom-built LiDAR including supplier lists, manufacturing details and statements of work with highly technical information.
"
11:54 AM

No Lens is Needed to See Simple Images

...
University of Utah, Salt Lake City, USA, researches show that the simple 32x32 images can be seen by a bare image sensor with no lens. The open-access paper "Lensless Photography with only an image sensor" by Ganghun Kim, Kyle Isaacson, Racheal Palmer, and Rajesh Menon has been published in arxiv.org. From the abstract:

"Photography usually requires optics in conjunction with a recording device (an image sensor). Eliminating the optics could lead to new form factors for cameras. Here, we report a simple demonstration of imaging using a bare CMOS sensor that utilizes computation. The technique relies on the space variant point-spread functions resulting from the interaction of a point source in the field of view with the image sensor. These space-variant point-spread functions are combined with a reconstruction algorithm in order to image simple objects displayed on a discrete LED array as well as on an LCD screen. We extended the approach to video imaging at the native frame rate of the sensor. Finally, we performed experiments to analyze the parametric impact of the object distance. Improving the sensor designs and reconstruction algorithms can lead to useful cameras without optics."

Example images taken with the VGA sensor. The left column shows
the objects displayed on the LED matrix. The 2nd column shows the raw
sensor images. The 3rd column shows the reconstructed images before
any processing. The right column shows the reconstructed images after
binary thresholding.
3:14 AM

Panasonic to Commercialize Heartrate Rate Extraction from Video

...
Nikkei: Panasonic exhibits a technology to accurately measure the heart rate of a person on video.The companys Contactless Vital Sensing utilizes the change of skin's light reflectance caused by blood. The reflectance changes with the contraction of blood vessels caused by heartbeat.

Panasonic aims to commercialize the technology in 2018 in such applications as sports, checking the stress of employees in call centers, preventing car drivers from falling asleep, etc.

2:34 AM

Samsung Mobile Processor Supports 4K 120fps Video, 28MP Cameras

...
Samsung announces its latest application processor (AP), the Exynos 9 Series 8895, manufactured in 10nm FinFET process. Its imaging, video, and machine vision features are rather impressive:

"It supports recording and playback of video contents at maximum resolution of 4K UHD at 120fps with the latest video codec including HEVC(H.265), H.264 and VP9.

[Exynos 8895] ISP supports high resolution up to 28MP for each rear and front camera with advanced features such as Smart WDR and PDAF. Exynos 8895 features dual ISP that consists of one ISP dedicated for high quality and the other for low power. Thus, it enables various combination of dual camera scenario for DSLR-like photography experience while consuming very low power.

Exynos 8895 features VPU (Vision Processing Unit) which is designed for machine vision technology. This technology improves the recognition of an item or its movements by analyzing the visual information coming through the camera. Furthermore, it enables advanced features such as corner detection that is frequently used in motion detection, image registration, video tracking and object recognition.
"

10:55 AM

Qualcomm Snapdragon 835 VR Development Kit Includes 4 Cameras

...
PRNewswire: Qualcomm introduces a new VR development kit (VRDK) based on Snapdragon 835 mobile platform. The kit includes 4 cameras:

  • Six degrees of freedom (6DoF) Motion Tracking: Two monochromatic, stereo- 1MP (1280x800) cameras with fish-eye lenses for each
  • Eye Tracking: Two monochromatic VGA global shutter cameras with active depth sensing

Older, Snapdragon 820-based VRDK
9:05 AM

Tessera Becomes Xperi

...
BusinessWire: Tessera is changing its name to Xperi Corporation (“Xperi”) and its Nasdaq ticker symbol to XPER, effective tomorrow, February 23. This change, which also includes a new corporate logo and brand platform, is a reflection of the company’s expanded capabilities, continued technological innovation and refined vision.

“Changing our name to Xperi is an incredible moment in our history,” said Tom Lacey, CEO of Tessera Holding Corporation. “Xperi represents the combination of DTS, FotoNation, Invensas and Tessera – world-class companies dedicated to creating solutions that enable extraordinary experiences for people around the world. Our new logo and brand identity convey the unlimited possibilities of what our team of approximately 700 employees can create to truly impact the human experience. We are constantly inspired by how people use our technologies in their lives, and that drives us to continue generating ideas and innovation. We cannot wait to show the world what’s next.”

1:18 PM

OmniVision and Corephotonics Dual-Camera Zoom Reference Design for Smartphones

...
PRNewswire: OmniVision announces its collaboration with dual-camera technology company Corephotonics in producing a new dual-camera zoom reference design for mobile devices. Combining OmniVision's OV12A10 and OV13880 image sensors with Corephotonics' proprietary zoom and Bokeh algorithms, the reference design brings optical zoom capabilities to smartphone camera applications.

The Corephotonics algorithms fuse the images from the wide-angle cameras and telephoto cameras to deliver optical zoom, increase resolution, reduce SNR and enable smoother video transitions. OmniVision's OV12A10 and OV13880 sensors benefits include:
  • Slim form factor enabled by reduced module height
  • PureCel Plus 1.25um large pixel and 1.0um small pixel
  • Dual-camera sync: master/slave capability to switch between sensors during zoom operation
  • Low power using unique toggle mode to extend phone battery life

"Corephotonics is widely regarded as a world leader in dual-camera technology," said Will Foote, senior partnership manager, OmniVision. "The rapid expansion of the dual-camera smartphone market gives us the perfect opportunity to combine our companies' expertise. We are pleased to introduce our first joint reference design, and are excited about many more future collaborations based on OmniVision sensors and Corephotonics' algorithm IP."
12:48 PM

Transfer Of Heat Podcast

...

Image result for podcast


This week, instead of writing a normal blog post, my classmate Sosina and I wrote and recorded a podcast about the transfer of heat, the difference between heat and temperature, and an experiment we conducted in class. Listen for more information and quite a few bad puns!

More about Mobileye 7.4MP Automotive Camera

...
SeekingAlpha: Mobileye Q4 2016 earnings call transcript has an interesting part about the company's 7.4MP autonomous driving camera platform:

Itay Michaeli - City analyst

...how important is the 2019 launch of the ultra-high resolution camera to automakers to be able to perform those Level 2 plus functions? And then if you could also comment on the hardware cost to the automaker of that camera relative to mono and trifocal today?

Amnon Shashua - CTO & Chairman

So, regarding the ultrahigh-definition camera, this is a 7.4 megapixel camera. 2019, we have programs that have a 1.7 megapixel camera. We have programs that have 2 megapixel cameras. These are parking cameras that are used also for autonomous driving, not only for parking. And we have the 7.4 megapixel, in many cases, it replaces the trifocal. So, we have a single mono camera with 120 degrees field view replacing three cameras. So, this particular camera is going to be more expensive. It’s not the imager that is so much more expensive, it is the lens. Lens is more expensive. So, it’s few – I can’t say exactly how much more expensive, but it is more expensive and this allows – so basically the ultrahigh-definition camera allows to replace the trifocal with a single monocular camera.

Thanks to DS for the link!
10:37 AM

Omnivision Agrees to License Ziptronix Technology

...
BusinessWire: Tessera subsidiary Ziptronix reached an agreement with OmniVision that provides OmniVision with a license under Ziptronix’s patents. In addition, the outstanding litigation among Ziptronix, OmniVision, and TSMC has been dismissed.

“We are pleased to have this matter resolved and to reach a license agreement with OmniVision, one of the leading image sensor suppliers in the world,” said Craig Mitchell, president of Invensas Corporation, a Tessera subsidiary. “The growing demand for enhanced imaging solutions for automotive, consumer, and mobile electronic devices continues to be a key driver for the adoption and proliferation of our ZiBond and DBI technologies.”
11:42 PM

Stuttgart University Proposes 3D Printed Microlens

...
Science Advances: University of Stuttgart, Germany, researchers propose to utilize a femtosecond laser-based 3D printer to print high precision multi-component microlens directly onto CMOS image sensor. Their paper "3D-printed eagle eye: Compound microlens system for foveated imaging" by Simon Thiele, Kathrin Arzenbacher, Timo Gissibl, Harald Giessen, and Alois M. Herkommer presents the new approach:

"We present a highly miniaturized camera, mimicking the natural vision of predators, by 3D-printing different multilens objectives directly onto a complementary metal-oxide semiconductor (CMOS) image sensor. Our system combines four printed doublet lenses with different focal lengths (equivalent to f = 31 to 123 mm for a 35-mm film) in a 2 × 2 arrangement to achieve a full field of view of 70° with an increasing angular resolution of up to 2 cycles/deg field of view in the center of the image. The footprint of the optics on the chip is below 300 um × 300 um, whereas their height is less than 200 um. Because the four lenses are printed in one single step without the necessity for any further assembling or alignment, this approach allows for fast design iterations and can lead to a plethora of different miniaturized multiaperture imaging systems with applications in fields such as endoscopy, optical metrology, optical sensing, surveillance drones, or security."

11:36 AM

TetraVue Raises $10M for Automotive LiDAR

...
MarketWired: South California-based TetraVue closes its Series A funding at $10M, led by Robert Bosch Venture Capital and Nautilus Venture Partners, and joined by Samsung Catalyst Fund as well as Foxconn. The funding will enable TetraVue to bring its Ultra High Definition, Solid State Flash LIDAR to the autonomous car industry, and to be the leader in Vision for Things (VfT).

"TetraVue is unparalleled to any other existing technologies in the three-dimensional Flash LIDAR space," said Luis Llovera, Managing Director of Robert Bosch Venture Capital. "We see its technology as being key to the enhancement and development of the autonomous car industry, which will be the future of transportation as we know it."

TetraVue’s core technology differentiation is their patented “light slicer” technology, which uses time and distance measurements in order to find optical intensities using standard CMOS sensors. The company’s approach yields many benefits including higher reliability to meet automotive requirements, low latency, and ability to produce ultra-high resolution images for a wider range of distances at a lower cost.

TetraVue’s technology results in 2 million or more simultaneous distance measurements of ranges—greater than 200 meters in any weather conditions and utilizes orders of magnitude less power than competitors. This performance is optimal for the autonomous car industry, and TetraVue plans to miniaturize and commercialize its fully functioning prototype.

Picture of car hitting wall of cardboard boxes taken with Tetravue LIDAR

One of the recent TetraVue's patent applications, US20150296201 "Systems and method of high resolution three-dimensional imaging" by Paul S. Banks, explains TetraVue LiDAR operation:

11:13 AM

ST Announces 3rd Generation ToF Sensor

...
ST releases its third-generation laser-ranging sensor based on its SPAD FlightSense technology. The new VL53L1 sensor adds for the first time, optical lenses to the module. This combination boosts core performance while introducing many new features including multi-target detection, cover-glass crosstalk immunity at long distance, and programmable multi-zone scanning. With a form factor of 4.9 x 2.5 x 1.56mm, the sensor module integrates a new lens system, a 940nm VCSEL light source, a processing core, and a SPAD photon detector.

The VL53L1 performs a full measurement operation in as little as 5ms, twice as fast as the earlier-generation devices, for high speed AF operation. It also has doubled the maximum ranging distance of ST ToF sensors to beyond 4.5 meters, ensuring it is well matched to the hyper-focal distance of widely used 21MP camera optics.

The new architecture can detect multiple targets within the scene and also allows manufacturers to sub-divide the SPAD sensing matrix into custom-defined zones. These small zones can then provide spatial ranging information that the customer application can use for dual-camera computation in stereoscopy as well as simple depth-map use cases.

The VL53L1 is in production now.

“ST has already shipped hundreds of millions of Time-of-Flight sensors, which have been designed by OEMs into over 70 smartphone models as well as many other consumer devices,” said Eric Aussedat, General Manager of ST’s Imaging Division. “The third-generation FlightSense product uses its improved performance to support new applications, including human-presence detection, while continuing to improve sensor performance for existing use cases.”

6:43 AM

Dual Camera Phones to Boost LG Innotek, SEMCO Revenues

...
The Korea Herald: Samsung Electro-Mechanics (SEMCO) and LG Innotek’s profits are growing on rising demand for dual camera phones, according to the newspaper's sources. SEMCO is supplying its dual cameras to Chinese Xiaomi and LeEco since Q3 2016 and it is also in talks with Huawei, Oppo and Vivo.

According to Counterpoint analysts, the sales of smartphones with dual cameras will rise more than 400% YoY to reach 300 million units in 2017.

11:01 PM

DALSA Works on DBI-Stacked Sensors

...
BusinessWire: Invensas, a wholly owned subsidiary of Tessera, announces that Teledyne DALSA has signed a technology transfer and license agreement for Direct Bond Interconnect (DBI) technology.

“DBI technology is a key enabler for true 3D-integrated MEMS and image sensor solutions,” said Edwin Roks, president of Teledyne DALSA. “We are excited about the prospect of developing new products and providing new foundry services to our customers that utilize this technology. By working closely with Invensas, we will be able to move more quickly to deploy this capability efficiently and effectively.”

“We are pleased that Teledyne DALSA, a recognized leader in digital imaging products and MEMS solutions, has chosen our DBI technology to accelerate the development and commercialization of their next generation MEMS and image sensor products,” said Craig Mitchell, President of Invensas.
9:42 PM

Global and China Imaging Industry Report, 2016-2020

...
ResearchInChina publishes "Global and China CMOS Camera System Industry Report, 2016-2020." Few quotes:

"In 2016, the CIS (CMOS Image Sensor) market size approximated USD10.516 billion, rising by 5.6% from a year ago, but with an obvious fall in the speed of growth compared with the growth rate of 13.5% in 2015, mainly because medium- and high-end products are monopolized by Sony and the manufacturers in low- and medium-end fields are hard to break through the technological barriers and do nothing but hit the price war even in the vehicle field.

Although influenced by factors like the Earthquake and the Appreciation of Japanese Yen, Sony still monopolized the medium- and high-end fields by dint of its overwhelming performance superiority and saw an upsurge of 32.9% in its revenue in 2016; by contrast, other players excluding Panasonic and Hynix saw decline. It is expected that, in 2017, the CIS market will grow 4.0%, Sony will see a growth rate of at least 10%, and most others will continue to suffer losses. In spite of being not much expected, the mobile phone market is still the most important market and Sony still monopolizes the high-end mobile phone market.

In 2015, the global CCM (CMOS Camera Module) market size reported USD16.611 billion, up 3.8% from a year earlier but the lowest growth rate since 2010. In 2016, as the shipment of Apple phones with the highest single price of CCM fell, the world CCM market was at low ebb and down 0.5%. Due to the dual-camera stimulus in 2017, the global market rebounds substantially with the growth rate of 4.3% and the size estimated to be USD17.232 billion in 2017 and USD18.512 billion in 2020.

In 2016, Chinese manufacturers made remarkable achievements, while South Korean counterparts saw a drop or slight rise in revenue due to their heavy reliance on Apple and Samsung. Among Chinese players, Q-Tech enjoys the highest growth rate up to 84.5%, followed by Truly, both of which benefited from the outstanding performance of big customers OPPO and VIVO.

It is anticipated that monochrome dual-camera with same pixel will be the mainstream for smart phone brands except Apple in the future, as it is more affordable and can improve nightscape significantly (visible effect betterment for consumers), while Apple will persist in duel-camera design enriching depth of focus. Smart phones tend to be highly homogenized. Although they are still not quite satisfied with the dual-cameras, consumers are more impressed with dual-cameras than mono-camera. So, dual-camera is expected to be a standard configuration in high-end smart phones, and the penetration rate till 2020 would be as high up to 30-40%.
"

12:07 PM

Sony Unveils 4 New GS Sensors

...
Sony presents 4 new GS CMOS sensors for industrial applications. The sensors have 1/2.9-inch format and include 1.58MP IMX273LLR/LQR and IMX296LLR, and 0.4MP large pixel IMX287LLR/LQR and IMX297LLR.


Sony also posts a video demo of GS sensor advantages:

11:49 AM

Yole on Medical Imaging Market

...
Yole Développement says that the solid-state medical imaging including CCD, CIS, a-Si FPD, a-Se FPD, and SiPM are step by step penetrating the medical imaging industry. Yole’s analysts estimate the solid state medical imaging device market at US$350 million in 2016 with a comfortable 8.3% CAGR until 2022.

“For some technologies and applications, wafer volume growth is very significant,” explains Yole’s Activity Leader, Pierre Cambou. “For example, the development of SiPM7 in the field of molecular imaging will multiply in quantity by more than 6x over the next five years. This massive transformation from photomultiplier tubes to solid-state IC was derived from the need of multimodal equipment (PET/MRI10) but it’s going to have a direct consequence in the field of PET/CT11 and spread all the way to SPECT12 imaging."

12:53 PM

Basler ToF Camera Promotional Video

...
Basler presents a video of its ToF camera features and applications. Basler calls it "the first high-resolution Time-of-Flight Camera in the mid-ranged price segment to offer such a broad variety of powerful Machine Vision features."

12:14 PM

Corephotonics Announces Collaboration with Samsung Electro-Mechanics

...
Corephotonics has partnered with Samsung Electro-Mechanics (SEMCO) to develop a complete camera module reference design, based on Corephotonics dual camera technology. Through this reference design, which is now in volume production, smartphone manufacturers get 5.5mm-slim dual camera designs with 3x optical zoom capability.

“The camera has become a key differentiator in the current, highly competitive global smartphone market. Via the dual camera zoom solution pioneered by Corephotonics and the access we have now gained to their technology, it is possible to greatly expand upon our current smartphone camera capabilities,” states EVP Hong, CMO of SEMCO. “This will take us closer than ever before to the imaging performance that would normally be associated with an SLR.”

“SEMCO is an acknowledged leader in smartphone camera modules and it is now fully equipped with a broad range of Corephotonics technology,” adds Eran Briman, VP of Marketing & Business Development at Corephotonics. “By integrating our calibration tools into its production lines, SEMCO is now better positioned for delivering mass production zoom dual camera modules which are drop-test certified and support relaxed calibration assembly. Combining such modules with Corephotonics’ zoom and bokeh algorithms easily satisfies consumer demands for elevated imaging functionality.”

12:01 PM

Everyday Heat Transfer

...
In class, we've been learning about heat, how it transfers, and the part it plays in our environment and our everyday lives. This week we read an article about the three different ways heat transfers. This article relates to what we learned in class because the article, by explaining convection, provided the missing piece in the metaphorical puzzle of what we'd been learning, adding that last link between different methods of transfer and the flow of heat in our atmosphere. It was interesting to learn about how knowledge of convection is used in simple ways, like the positioning of vents in the north versus the south.

The Transfer Of Heat 

Heat, put simply, is the movement of molecules, or kinetic energy. Heat transfers in three different ways.

First, heat transfers through conduction. This is transfer through direct contact, like when you touch a cookie sheet right out of the oven and burn yourself. The heat transferred directly from the hot metal of the cookie sheet into your hand, so it transferred through conduction.

Image result for radiation heat transferSecond, heat transfers through radiation. This is transfer through the air, like when you hold your hand close to a candle and feel the heat coming - radiating - off of it. The heat transferred through the air, from an area of higher kinetic energy to an area of lower kinetic energy, so it transferred through radiation.

Third, heat transfers through convection. This is heat transfer through fluids and the circular movement that results when said fluids are heated from below. Fluids, in this case, refers to both air and water, based on how they move. In convection, the molecules performs a sort of dance, heating up when they are close to the heat source at the bottom and expanding, moving upwards, replacing the colder molecules above, which then fall back down where they are heated and become the warmer molecules, which again move upwards and replace the now cold molecules, continuing the dance.

The Heating Of Our Atmosphere

You see heat transfer in small, everyday things, like cookie sheets and candles, but it also plays a big part in maintaining the comfortable environment we live in. One important way is in the heating of our atmosphere. The atmosphere is heated in two main ways.

First, it is heated by infrared radiation, which radiates directly from the sun and is responsible for about 1% of our heat. This is because very few molecules in the air can actually absorb heat - only water and carbon dioxide can.

Second, it is heated indirectly by visible light, which is absorbed by the Earth's surface and conducted back into the atmosphere. This accounts for much more of the heat in our atmosphere, and this process, reradiation, is why our atmosphere is heated mostly from below.

In addition to these, convection also plays an important part in heating the atmosphere, because once air is heated by the Earth's surface, it begins the convection process.

The Heating Of Our Earth

In class this week, we explored how the sun heats different earth materials in our "Heating The Earth" lab. In this lab, we set up an experiment where we heated containers of sand, water, and air under a sun lamp for ten minutes then turned the lamp off and monitored the samples for an additional ten minutes. We took the temperature of each material every two minutes throughout the entire twenty minutes.

Image result for hot sand
Our results were as follows. The air heated and cooled at a consistent rate, increasing about 1 degree per minute and then cooling at the same rate. The water also heated fairly consistently, if a little bit slower, and then retained its heat longer, only dropping by one degree during the last two minutes. The sand heated slowest of all, increasing only two degrees in ten minutes, but then retained that heat for the entire ten minutes the lamp was off.

Since the materials were exposed to the exact same amount of sunlight - we measured to make sure each one was the exact same distance and same angle away from the lamp - the difference wasn't in the amount of sunlight received, but in the amount of sun absorbed (the specific heat capacity) of each material.

This connects to what we learned in class about the heating of the earth and atmosphere, because the fact that air doesn't conduct heat well also explains why it doesn't it retain it. The results from our sand sample also show why the earth is so much better at absorbing heat from the sun.

The Transfer Of Heat - Example 

A specific example of all three types of heat transfer is the process of making tea. First, you heat the water over a flame on the stove, heating the metal kettle by radiation. The water then heats by convection, warming up at the bottom of the pot then rising and replacing the falling cold water above it. Once the water is heated, you pour it in a mug, and let the teabag steep. However, maybe you're excited and drink it too early, burning your tongue as heat from the water conducts directly onto your tongue. To review - heat from the stove flame radiates to the kettle, the water is heated by convection, and the water conducts heat to your tongue when you drink your tea. All while you enjoy the temperature of your house, kept comfortable by the everyday transfer of heat.