October 2016 ~ engineering information technology

MediSens Conference Agenda

online engineering degree/engineering degree online/online engineering courses/engineering technology online/engineering courses online/engineering technician degree online/online engineering technology/electronic engineering online

MediSens conference to be held in London, UK on Dec 13-14, 2016, announces its agenda:

A brief history of medical imaging
• Imaging in the pre-digital age
• The breakthrough of digital X rays – applications in medical and beyond
• Impact of digitisation on the clinical environment
• Lessons learned by a pioneer in digital X rays
• Some thoughts about the future…
Special Guest Keynote

Delivering an approach driven by clinical need
• Developments and challenges in cancer detection
• Understanding the technical and human challenges for medical imaging
• New techniques towards 3D quantitative imaging to ensure early and improved diagnosis and effective treatment
• Patient-specific diagnosis – Precision Medicine and personalised care
Dr Dimitra Darambara, Team Leader – Multimodality Molecular Imaging, The Institute of Cancer Research

An overview of research and development into molecular imaging
• Understanding the challenges in molecular imaging
• Multi modal imaging: what are the data implications?
• Assessing the advantages and opportunities of molecular imaging for patient groups v cost
• Advantages of PET/SPECT/CT, optical- PET, SPECT-MRI , PET-MRI: which mode has the best clinical potential?
Speaker TBC

Advances in (digital) single-photon detectors for PET
• Single-photon Avalanche Diode (SPAD) fundamentals
• From single SPAD pixels to arrays and systems
• Examples of state-of-the-art SPAD-based PET systems and frontline R&D activity
Dr Claudio Bruschini, Project Manager & Senior Scientific Collaborator, EFPL

Computing Tomography using a proton therapy beam: The Pravda collaboration
• Translation of technology from basic science to medical imaging
• Challenges of imaging proton beams
• Pravda integrated imaging system for proton beam computed tomography
Dr Phil Evans, Professor of Medical Radiation Imaging, Centre of Vision, Speech and Signal Processing, University of Surrey

What’s going on in the world of solid state medical imaging
• Exploring the new wave of innovation focused on CMOS image sensors in the solid state medical imaging market
• Assessing the status of CIS technology and related medical imaging applications
Jérȏme Mouly, Technology & Market Analyst, Yole Developpement

Advances in CMOS Wafer scale imagers for medical imaging
• Clinical needs of x-ray imaging modalities, how they flow down to detector CTQs (critical to quality)
• CMOS detector benefits and challenges (IQ, artefacts, reliability, cost)
• Opportunities for CMOS in medical imaging
Dr Biju Jacob, Senior Engineer, X-ray Detector Development, General Electric

How CMOS can be further leveraged to advance medical imaging
• CMOS Image Sensor (CIS) technology: where it is today
• What can CIS bring to the medical imaging community
• Where is the technology going and how could this impact medical imaging
Dr Renato Turchetta, CEO, Wegapixel

Use of hybrid-organic x ray detectors to improve the specifity and sensitivity of digital flat panel x ray detectors
• X-ray imaging with hybrid organic-inorganic conversion layers
• Scintillator particles embedded in an organic semiconducting matrix
• Digital flat panel X-ray detectors using a “quasi-direct” X-Ray conversion technology
• Hi resolution digital flat panel X-ray detectors
• DiCoMo: Combination of hybrid frontplane and active pixels backplane made of metal oxide TFTs
Dr Sandro Tedde, Senior Key Expert Research Scientist, Siemens Healthcare

Image enhanced endoscopy and the image sensor design for further diagnosis accuracy
• Introduction of technical aspect of image enhanced endoscopy
• Effort for smaller diameter of the endoscopes and high resolution of tiny camera
• Requirements for image sensor design in terms of the high occupancy of the secured pixel area
• High resolution and high S/N ratio
Koichi Mizobuchi, Deputy General Manager, Medical Imaging Technology Department, Olympus Corporation

Advances in cardiac imaging: what it means for the future possibilities of X ray technology
Prof Gary Royle, Professor of Medical Radiation Physics, UCL

Disease diagnosis in the distal lung using time-resolved CMOS single photon detector arrays
• Fibre-based sensing and imaging system allowing minimally invasive diagnostics in the distal lung
• Sensing physiological parameters like pH through exogenous fluorophores or Surface Enhanced Raman Sensors (SERS)
• Application of SPAD sensors to aid in the disambiguation between bacterial fluorescent probes and tissue fluorescent signals
Prof Robert Henderson, Institute of Integrated Micro and Nano Systems, University of Edinburgh

Closing keynote: How robotics is changing the face of surgery
• Understanding the imaging requirements for surgical robots
• Current and future computer vision specifications
• How robotics could impact diagnosis and treatment
Professor Guang-Zhong Yang, Director & Co Founder, Hamlyn Centre of Robotic Surgery & Deputy Chairman, Institute of Global Health Innovation, Imperial College London

Other than the main conference, there is also a workshop by Albert Theuwissen:

First Session:
• CMOS image sensor basics
• Rolling and global shutter
• Ins and Outs of 1-transistor, 3-transistor and 4-transistor pixels
Second session:
• From X-rays to digital numbers
• Stitching to make monolithic large area devices
• Butting to make large imaging arrays
• Binning and averaging
• Yield/cost of large area imagers

ST CEO on ToF Business

SeekingAlpha: ST CEO Carlo Bozotti updates on the company's ToF sensor business: "We had a very strong sequential increase in sales due to the success of our new specialized image sensors based on our proprietary Time-of-Flight technology. In fact, we are seeing strong momentum globally. During the third quarter, we were present in 11 new smartphones, including a new product in flagship phones launched on the market. In addition in Q3, the imaging product division turned to profit.

...in Q3 we are profitable on our imaging business. It is all new products. It's new technologies. Has nothing to do with what we had in the past. That has been completely removed. And it's a part of a strategy of the company because we want to be a big sensor company. Today the run rate that we have in sensors is already above $1 billion and we want to keep going. It's all good products. It's very important for many applications from smartphones to IoT to automobile. It is an important part of the strategy of the company. Of course, this specialty in the sensors I think is a lot of new technologies that we have developed."

Zombie Cameras On the Internet of Things

On Friday, Oct. 21, millions of Internet users trying to access popular websites including Twitter, Netflix, the New York Times, and Wiredsuddenly saw them stop working. The reason was that for a few hours, a massive distributed-denial-of-service (DDOS) attack hit a domain-name-server (DNS) company called Dyn, based in New Hampshire. As I mentioned in last week's blog, DNS companies provide a sort of phone-book service that turns URLs such as www.google.com into machine-readable addresses that connect the person requesting a website to the server that hosts it. They are a particularly vulnerable part of the Internet, because one DNS unit can handle requests for thousands of websites, so if you take that DNS machine down, you've automatically damaged all those websites as long as the DNS is out of service.

DDOS attacks are nothing new, but the Oct. 21 attack was the largest yet to use primarily Internet-of-Things (IoT) devices in its "botnet" of infected devices. The Internet of Things is the proliferation of small sensors, monitors, and other devices less fancy than a standard computer that are connected to the Internet for various purposes.

Here's where the zombie cameras come in. Say you buy an inexpensive security camera for your home and get it talking to your wireless connection. If you're like millions of other buyers of such devices, you don't bother to change the default password or otherwise enhance the security features that would prevent unauthorized access to the device, like you might do if you bought a new laptop computer. Security experts have known for some time about a new type of malware called Mirai that takes over poorly protected always-on IoT devices such as security cameras and DVRs. When the evil genius who sent out the Mirai malware sends a signal to the infected gizmos, they all start spouting requests to the targeted DNS server, which immediately gets buried in requests and can't respond to anybody. That is what a DDOS attack is.

As the victim learns the nature of the requests, programmers can mount a defense, but skillful attackers can foil these defenses too, for a time, anyway. The attackers went away after three attacks that day, each lasting a couple of hours, but by then the damage had been done. The attacks made significant dents in the revenue streams of a number of companies. And perhaps most importantly, we learned from experience that the much-ballyhooed Internet of Things has a dark side. The question now is, what should we do about it?

Sen. Mark Warner, a Democrat from Virginia, has reportedly sent letters to the FCC and other relevant Federal agencies asking that same question. According to a report on the website Computerworld, Warner has a background in the telecomm industry and recognizes that government regulation may not be the best answer. For one thing, Internet technology can change so fast that by the time a legislative or administrative process finally produces a regulation, it can be outmoded even before it's put into action. Warner thinks that the IoT industries should develop some kind of seal of security approval or rating system that consumers could use to compare prospective IoT devices before they buy.

This may get somewhere, and then again it may not. The reason is that an IoT device that can be used in a DDOS attack but otherwise functions normally as far as the consumer is concerned, is a classic case of what economists call an "externality."

A more familiar type of externality is air-pollution abatement devices on cars: catalytic converters, the diesel exhaust fluid that truckdrivers now have to buy, and all that stuff. None of it makes your car run better; in fact, cars can get better mileage or performance if they don'thave that anti-pollution stuff working, as Volkswagen knew when it purposely disabled the anti-pollution function on some of its diesel models and turned it on only to pass government inspections. The pollution your car would cause without anti-pollution equipment is an externality. The additional pollution that your car causes is so small that you won't notice it. Only when you add up the contributions of the millions of cars in a city does it become a problem. But if you don't have anti-pollution stuff on your car, you're adding a tiny bit to the air pollution that everybody in your city has to breathe. It's that involuntary aspect, the fact that other people are put at a disadvantage because of your action (or inaction), that makes it an externality.

The vulnerability of IoT devices to being used in DDOS attacks is an externality of a similar kind. When you buy and install a security camera, or rent a DVR from your cable company, and they don't have enough security software installed to prevent them from being used in a DDOS attack, you're raising the risk of such an attack for everybody on the Internet. And they don't have a choice in the matter.

Historically, externality problems such as air and water pollution have been resolved only when the government gets involved at some level. When the externality problems are strictly local, sometimes local political pressures can resolve the issue, but the Internet is by its nature a global thing, in the main, although for reasons that are not entirely clear, the Oct. 21 attacks affected mainly East Coast users. So my guess is that to fix this issue, we are going to have to have national or international governmental cooperation to set some rules and fix minimum standards for IoT devices regarding this specific problem.

The solutions are not that hard technically: things like attaching a unique username and password to each IoT device and designing them to receive security updates. These measures are already in place for conventional computers, and as IoT devices get more sophisticated, the additional cost of these security measures will decline to the point that it will be a no-brainer, I hope.

But right now there's millions of the gizmos out there that are still vulnerable, and it would be very hard to get rid of them by any means other than waiting for them to break or get replaced by new ones. So we have created a serious security problem that somebody, somewhere has figured out how to take advantage of. Let's hope that the Oct. 21 attack was the last big one of this kind. But right now that's all it is—just a hope.

Sources: I referred to the article " What We Know About Friday’s Massive East Coast Internet Outage" by Lily Hay Newman of Wired at https://www.wired.com/2016/10/internet-outage-ddos-dns-dyn/,and the article "After DDOS attack, senator seeks industry-led security standards for IoT devices" by Mark Hamblen at http://www.computerworld.com/article/3136650/security/after-ddos-attack-senator-seeks-industry-led-security-standards-for-iot-devices.html. I also referred to the Wikipedia articles on "externality" and "Mirai" (which means "future" in Japanese).

Daqri AR Helmet Features Array of Cameras

Bloomberg reports that Daqri, a Los Angeles-based maker of AR helmets for workplaces, is seeking to raise as much as $200M in funding. The AR helmet comes with a full zoo of cameras:

Senior Engineer–Piping Petrofac Limited

Senior Engineer–Piping Petrofac Limited Job Description 1. Scope of Responsibilities Lead and operate as a part of a team of engineers and designers in carrying out detailed engineering work; assume responsibility for conceptual and detailed design (Concept, Front End or Basic, Material, Stress Analysis, Layout Engineering, Coordination of 3D modelling) and provide necessary technical

Sony Unveils DOL-HDR Sensors

After a long hiatus, Sony unveils two new 1.62um pixel image sensors featuring Digital Overlap (DOL) HDR mode. The 1/2.9-inch 6.82M IMX326LQC and 1/2.5-inch 8MP IMX274LQC are pin-compatible and target industrial and security applications. When in DOL HDR mode, the frame rate drops to the half of the one in normal mode.

Imager Mania publishes a nice overview of different HDR approaches that Sony used over the years (in Japanese).

Caeleste News

Caeleste is nominated for the Deloitte 2016 50 fastest growing Belgian tech companies list. Made in Mechelen web site quotes the company CEO Patrick Henckes (Google translation):

"We have indeed grown in recent years with a prudent rate of 30 to 80% per year. We have an excellent reputation in the very specific niche market of image sensors, a sector in which Flanders has acquired a leading position on the world stage. Of ten firms active in our market, there are three in Flanders.

Our customers are top companies themselves, who want to make their products want to be better than the competitors and for this purpose a sensor to measure, giving it inspected all the existing sensors. We call it beyond state of the art . Something that already exists, we will not make it. Our customers are also distributed worldwide, we have to 9 am conference calls with Japan and at 6 pm conference calls with California. And our customers are in many diverse fields: aerospace (ESA), astronomy, nuclear physics, engineering, microscopy and many other scientific applications, medical applications such as DNA sequencing, edm ... You come to us all against top research areas in the world."

Caeleste announces its two oncoming papers to be presented at CNES Image Sensor Workshop to be held on Nov. 26-27 in Toulouse, France:

"Caeleste will present its radiation hardened design data base as well as the effects of radiation on image sensors realized in that technology. We will focus especially on the differences in behavior between ionizing and non-ionizing radiation.

The blue dots and circles show the effect of ionizing radiation on dark signal, while the red dots and circles are the effects of non-ionizing radiation (electrons in this case). The difference in behavior between the photodiode itself and the sense node will also be explained."

Caeleste will also present its new pixel combining photon counting for low light condition with charge integration for high flux situations.

Arctic sea ice extent again at record low for time of year

For some time, Arctic sea ice extent has again been at a record low for the time of the year. The image below shows Arctic sea ice extent on October 26, 2016, when extent was only 6.801 million km².

One reason for the low sea ice extent is the high and rising temperature of the Arctic Ocean. On October 27, 2016, the Arctic Ocean was as warm as 14.8°C or 58.6°F (green circle near Svalbard), 12.1°C or 21.7°F warmer than 1981-2011, as the image below shows.

On October 29, 2016, the Arctic Ocean was as warm as 14.9°C or 58.8°F (green circle near Svalbard), 12.1°C or 21.8°F warmer than 1981-2011, as the image below shows.

As the sea ice shrinks, less sunlight gets reflected back into space, while more open water and higher sea surface temperatures also cause storms and cyclones to become stronger. Stronger cyclones also cause greater amounts of water vapor to move up the Pacific Ocean and the Atlantic Ocean toward the Arctic.

[ click on image to enlarge ]

Less Arctic sea ice and a warmer Arctic Ocean make that more heat and water vapor gets transferred from the Arctic Ocean to the atmosphere. The two above images show temperature forecasts for November 1 & 2, 2016. In both cases, temperatures over the Arctic as a whole are forecast to be as much as 6.40°C higher than 1979-2000.

As these images show, temperature anomalies in many places are at the top end of the scale, i.e. +20°C or +36°F.

Above combination image shows record low Arctic sea ice for the time of the year (left) and near record low Antarctic sea ice for the time of the year (right), with a combined sea ice extent of only 23.751 million km² on October 28, 2016. In other words, the world is now absorbing a lot of sunlight that was previously reflected back into space.

Below are two further temperature forecast:

Above image shows forecasts for October 31, 2016. The Arctic is forecast to be 6.07°C warmer than 1979-2000, while the Antarctic is forecast to be 4.56°C warmer than 1979-2000.

Above image shows forecasts for November 1, 2016. The Arctic is forecast to be 6.42°C warer than 1979-2000, while the Antarctic is forecast to be 3.70°C warmer than 1979-2000.

Rising temperatures over the Arctic further contribute to a rise in the amount of water vapor in the air over the Arctic at a rate of 7% more water vapor for every 1°C warming. Since water vapor is a potent greenhouse gas, more water vapor further accelerates warming in the Arctic.

The Climate Reanalyzer image below shows the temperature rise in the Arctic over time.

In the video below, Dr. Walt Meier of NASA Goddard Space Flight Center describes how the Arctic has been losing its thicker and older sea ice over the years (1991 to September 2016).

The Naval Research Lab 30-day thickness animation below (up to October 28, 2016, with forecasts up to November 5, 2016) further shows minimal recent growth of the Arctic sea ice, especially in terms of the ice with a thickness of 1m or above.

As the Arctic Ocean gets warmer, the danger grows that large amounts of methane will erupt from destabilizing hydrates at its seafloor. Ominously, high methane levels are visible over the Arctic on the image below, showing methane levels as high as 2424 ppb on October 24, 2016.

The animation below, made with images from another satellite (and a different scale), shows high methane levels over th Arctic Ocean from October 26 to 28, 2016.

The situation is dire and calls for comprehensive and effective action, as described in the Climate Plan.

ASICFPGA Offers HDR ISP Pipeline

ASICFPGA offers an ISP pipeline with many features, including HDR processing, but, apparently, not including small pixel support:

Support RGB Bayer progressive image sensor
Support 8 ~ 14 bit input data Bayer
Support image sensor of 256*256 ~ 8192*8192 size
Defect Correction
Lens Shading Correction
High quality interpolation
3D Motion Adaptive noise reduction and 2D noise reduction
Color correction by 3x3 matrix
Gamma correction
HDR processing for Multiple exposure images and HDR bayer image
WDR (Shadow/Highlight compensation, back light compensation)
2D edge enhancement
support AE, AWB and AF
Saturation, contrast and brightness control
Support special images (sepia, negative, solarization)

The company's demo video shows the HDR capabilities:

Chronocam Raises $15M Series B Led by Intel Capital

MarketWired, BusinessWire: Chronocam SA announces it has raised $15M in Series B round led by Intel Capital, along with iBionext, Robert Bosch Venture Capital GmbH, 360 Capital, CEAi and Renault Group.

Chronocam will use the investment to continue building a world-class team to accelerate product development and commercialize its computer vision sensing and processing technology. The funding will also allow the company to expand into key markets, including the US and Asia.

“Conventional computer vision approaches are not well-suited to the requirements of a new generation of vision-enabled systems,” said Luca Verre, CEO and co-founder of Chronocam. “For example, autonomous vehicles require faster sensing systems which can operate in a wider variety of ambient conditions. In the IoT segment, power budgets, bandwidth requirements and integration within sensor networks make today’s vision technologies impractical and ineffective.

Chronocam’s unique bio-inspired technology introduces a new paradigm in capturing and processing visual data, and addresses the most pressing market challenges head-on. We are well-positioned to capitalize on this significant market opportunity; and we appreciate the confidence demonstrated by our investors as we roll out our technology to an increasing number of customers.”

Light L16 Camera Article

IEEE Spectrum publishes Light Co. founder Rajiv Laroia's article "Inside the Development of Light, the Tiny Digital Camera That Outperforms DSLRs." Few quotes:

"...molded plastic lens technology had been nearly perfected over the previous five years to the point where these lenses were “diffraction limited”—that is, for their size, they were as good as the fundamental physics would ever allow them to be. Meanwhile, the cost had dropped dramatically: A five-element smartphone camera lens today costs only about US $1 when purchased in volume. (Elements are the thin layers that make up a plastic lens.) And sensor prices had plummeted as well: A high-resolution (13-megapixel) camera sensor now costs just about $3 in volume.

By using many modules, the camera could capture more light energy. The effective size of each pixel would also increase because each object in the scene would be captured in multiple pictures, increasing the dynamic range and reducing graininess. By using camera modules with different focal lengths, the camera would also gain the ability to zoom in and out. And if we arranged the multiple camera modules to create what was effectively a larger aperture, the photographer could control the depth of field of the final image.

The first and current version of the Light camera—called the L16—has 16 individual camera modules with lenses of three different focal lengths—five are 28-mm equivalent, five are 70-mm equivalent, and six are 150-mm equivalent. Each camera module has a lens, an image sensor, and an actuator for moving the lens to focus the image. Each lens has a fixed aperture of F2.4.

Five of these camera modules capture images at what we think of as a 28-mm field of view; that’s a wide-angle lens on a standard SLR. These camera modules point straight out. Five other modules provide the equivalent of 70-mm telephoto lenses, and six work as 150-mm equivalents. These 11 modules point sideways, but each has a mirror in front of the lens, so they, too, take images of objects in front of the camera. A linear actuator attached to each mirror can adjust it slightly to move the center of its field of view.

Each image sensor has a 13-megapixel resolution. When the user takes a picture, depending on the zoom level, the camera normally selects 10 of the 16 modules and simultaneously captures 10 separate images. Proprietary algorithms are then used to combine the 10 views into one high-quality picture with a total resolution of up to 52 megapixels.

Our first-generation L16 camera will start reaching consumers early next year, for an initial retail price of $1,699. Meanwhile, we have started thinking about future versions. For example, we can improve the low-light performance. Because we are capturing so many redundant images, we don’t need to have every one in color. With the standard sensors we are using, every pixel has a filter in front of it to select red, green, or blue light. But without such a filter we can collect three times as much light, because we don’t filter two-thirds of the light out. So we’d like to mix in camera modules that don’t have the filters, and we’re now working with On Semiconductor, our sensor manufacturer, to produce such image sensors."

Harvest Imaging Forum 2016 is Almost Sold Out

Albert Theuwissen reports that the Harvest Imaging Forum 2016 is almost sold out: there are only 4 seats left in the session of December 8th and 9th 2016.

Mentor Graphics CEO on Image Sensor Market Growth

Mentor Graphics CEO Wally Rhines presents his view on the semiconductor industry and says few words on image sensor market (the link works only in Internet Explorer for me):

SK Hynix to Try Foundry/Custom Model for its CIS Business

ETNews: As Hynix moves into 13MP sensors mass production at its 300mm M10 fab in Icheon in 2017, the company plans to reduce production of the low-priced low resolution CIS at 200mm M8 plant in Cheongju. Instead, it is going to outsource the low cost sensor production to other foundries such as DDIC and PMIC. Eventually, SK Hynix is going to stop low-resolution sensor production at M8 fab.

As a part of this plan, SK Hynix publicly announced that it has recently received all SiliconFile's assets of $3.98 million (4.5 billion KRW) from SiliconFile, which is 100% CIS design subsidiary. Silicon File is becoming SK Hynix’s CIS design house. SiliconFile is supposed to find new fabless customers.

"Experts believe that variety of businesses that have been competing against each other in a field of fabless design can become customers of Silicon File." SK Hynix appointed Director Lee Dong-jae serving as the department head of foundry business department, as SiliconFile board director.

“Receiving company assets from Silicon File and changing Silicon File into a design house indicate that SK Hynix is officially promoting its non-memory semiconductor business,” says ETNews industry source.

Hynix VP KD Yoo who has established and led Hynix image sensor business over the years, left the company and now is a Professor at Hanyang University.

SK Hynix in Cheongju. White building at 2 o’clock is M8

DENSO Works with Toshiba and Sony on ADAS

JCN Newswire: DENSO and Toshiba have reached a basic agreement to jointly develop a Deep Neural Network-Intellectual Property (DNN-IP), which will be used in image recognition systems which have been independently developed by the two companies for ADAS and automated driving technologies.

Because of the rapid progress in DNN technology, the two companies plan to make the technology flexibly extendable to various network configurations. They will also make the technology able to be implemented on in-vehicle processors that are smaller, consume less power, and feature other optimizations.

DENSO has been developing DNN-IP for in-vehicle applications. By incorporating DNN-IP in in-vehicle cameras, DENSO will develop high-performance, ADAS and automated driving systems. Toshiba will partition this jointly developed DNN-IP technology into dedicated hardware components and implement them on its in-vehicle image recognition processors to process images using less power than image processing systems with DSPs or GPUs.

DENSO also invests in the US-based machine learning startup THINCI. “We are thrilled DENSO is our lead investor,” said THINCI CEO Dinakar Munagala. “The automotive industry is one of the earliest adopters of vision processing and deep learning technology. DENSO’s investment in THINCI’s trailblazing solution confirms our own belief that our innovation has much to offer, not only in the automobile but in the wide range of everyday products.”

JCN Newswire: DENSO announces that the image sensors provided by Sony have helped DENSO improve the performance of its in-vehicle vision sensors and can now detect pedestrians during night conditions.

Sony image sensors, which are also used in surveillance and other monitoring devices, enable cameras to take clear images of objects even at night. DENSO has improved the quality of Sony's image sensors in terms of ease of installation, heat resistance, vibration resistance, etc. to be used in vehicle-mounted vision sensors. DENSO has also used Sony's ISPs for noise reduction and optimization of camera exposure parameters to better recognize and take clearer images of pedestrians at night.

Remote Sensing Trends

SPIE publishes Stephen Marshall of University of Strathclyde (UK) talk on trends in remote sensing, including miniaturized multi- and hyperspectral cameras and other devices incorporated into drones and other flying sensors:

IHS on Security Market Trends

IHS publishes Top Video Surveillance Trends for 2016 report. Few quotes:

"4K video surveillance has been repeatedly touted as a major trend in video surveillance for the last 18 months and it can sometimes be challenging to see past the marketing hype. Yet make no mistake, the video surveillance market is going to 4K cameras; it’s only a matter of when rather than if. For 2016, IHS is predicting:
• Volumes of 4K cameras shipped in 2016 will remain low, less than 1% of the 66 million network cameras projected to be shipped globally. We are unlikely to see over million 4K network cameras units shipped in a calendar year until 2018.
• More “4K-compliant” cameras will be launched because of the increased use of 4Kp30 and above chipsets, meaning more cameras adhering to 4K standards, such as SMPTE ST 2036-1.
• Like the HD surveillance cameras, early 4K models offered the resolution at lower frame rates. We’ll see more cameras with a higher frame rate offered, and closer ties to other video standards."

eWBM Launches its 2nd Gen Dual Aperture Depth Map Processor: DR1152

PRNewswire: eWBM launches the DR1152 depth map processor, the successor to the DR1151 dual aperture processor.

The DR1152's predecessor, DR1151 (announced last year), accomplished cost reduction in the depth map processor market by implementing Dual Aperture's 4-color 3D image solution technology which extracts RGB and IR signals from a single image sensor. The DR1152 increases its depth level to 121 (nearly 8 times compared to the predecessor). Unlike the predecessor, which works only with 4-color sensors, the DR1152 now supports both 4-color and 3-color image sensors. eWBM believes that the 3-color adaptation opens a new market sector since it removes the barrier of sourcing only 4-color image sensors. This will expedite time-to-market significantly since widely available image sensors can be bought off the self.

The DR1152 supports a depth image resolution of up to XGA (1024 x 768) at 30 fps or 60 fps at VGA resolution. The technologies such as blur channel depth combining, noise reduction, and edge thinning technology are included in the new product. With all these significant improvement, DR1152 contains less gate count compared to its predecessor.

Omnivision Announces Two Purecel Sensors

PRNewswire: OmniVision announces the OV12895, a PureCel Plus-S stacked-die sensor. The 12MP sensor leverages a 1.55um pixel and high-speed architecture aimed to consumer-grade drones, surveillance systems, and 360-degree action cameras.

"We are seeing rapid growth in the markets for consumer drones, surveillance systems, and 360-degree action cameras, in part due to the increasing demand for aerial photography and 4K-resolution panoramic videos in security and virtual reality applications. The 12-megapixel OV12895 aligns well with these consumer product segments because it strikes a balance between solid pixel performance and high resolution, in a widely used 1/2.3-inch optical format," said Kalairaja Chinnaveerappan, senior product marketing manager at OmniVision. "The OV12895 builds on our latest-generation PureCel Plus-S stacked-die architecture and has many desirable features for these applications."

PRNewswire: OmniVision announces latest addition to its PureCel image sensor line, the OV2732. Due to the OV2732's HDR mode, power efficiency and small dimensions, the sensor is suited for compact and ultra low-power surveillance devices.

"The industry is seeing a tremendous increase in demand for IoT-compatible home monitoring systems. Today, resolution at 720p is already considered a mainstream segment, and interests in ultra low-power and good low-light 1080p imaging solutions are now on the rise," said Chris Yiu, senior strategic marketing manager at OmniVision. "Available in a 1/4-inch optical format, the OV2732 sets itself apart by delivering crisp 1080p HD video with advanced features such as frame synchronization and staggered HDR within a cost-effective and power efficient package. It's truly a no-compromise imaging solution for the security market."

Both sensors are currently available for sampling, and are expected to enter volume production in Q1 2017.

ams Acquires Heptagon

Austria-based ams is to acquire 100% of the shares in Heptagon dealing with optical packaging and micro-optics, that, in turn, has acquired MESA imaging an couple of years ago. Heptagon’s headquarters and manufacturing are based in Singapore while its R&D center is in Rueschlikon, Switzerland, and Silicon Valley, USA. The company has over 830 employees including around 120 engineers and 500 manufacturing staff. Heptagon's IP portfolio, primarily in optical packaging, includes more than 250 patent families.

Heptagon’s current 12 month revenue run rate is around USD 90m at negative operating profitability due to current underutilization of production capacity. Heptagon expects substantial revenue growth over the coming years starting mid-year 2017, based on its existing revenue and capacity pipeline and customer commitments. To prepare for this expected growth, Heptagon has already embarked on a major expansion of its Singapore manufacturing capacity with a total capital investment of more than USD 250m in 2016/2017. The expansion is based on a confirmed customer commitment for usage of the additional capacity and is fully funded from existing cash in the business, requiring no funding by ams.

The transaction combines an upfront consideration in cash and shares with a substantial deferred earn-out consideration. The upfront consideration includes USD 64m in cash from available funds, a capital increase of 15% of outstanding shares from authorized capital (excluding subscription rights) and shares from currently held treasury shares for a total value of the upfront consideration of approx. USD 570m. The earn-out consideration will be contingent on future results of Heptagon’s business over fiscal year 2017 with a potential maximum value of USD 285m. Following the upfront share transaction, current Heptagon shareholders which include financial investors, management, and employees are expected to hold around 20% in ams. The transaction is expected to close within the next three months.

Tech.eu estimates the total acquisition price at up to $919 million, or approximately €845 million, if Heptagon hits the targets set for its next fiscal year. "Heptagon has raised tens of millions over the years, including from GGV Capital, Innovations Kapital of Sweden, Innovacom of France, Nokia Growth Partners, High Tech Private Equity, Credence Partners, Jolt Capital, AAC Technologies and Heliconia Capital Management."

Alexander Everke, CEO of ams, commented on the transaction, “Combining ams and Heptagon creates the clear #1 in optical sensing technologies and fast-tracks our innovation capabilities. As a result, we expect ams to drive the optical sensing agenda in the years to come and broaden its market reach. Together with our leadership position in our other sensing focus areas Environmental, Imaging, and Audio, this strategic transaction is going to transform ams into the global leader in sensor solutions.”

Update: Antonio Avitabile, Sony Europe, comments at LinkedIn: "congrats Bo [Ilsoe] and Heptagon team. I understand cash was 64mln USD for an almost 1bln USD deal. Great job on the buying side."

Omnivision Announces Low Power 1/3-inch 1080p30 Sensor for Security Applications

PRNewswire: OmniVision announce OV2735, a 1080p30 image sensor for mainstream security and surveillance cameras. "The 1/3-inch 1080p sensor is the most popular format in the mainstream surveillance camera market. Given its excellent performance and advanced features, the OV2735 is one of the most competitive drop-in camera solutions available for this segment," said Chris Yiu, senior strategic marketing manager at OmniVision. "The OV2735 leverages our proven OmniPixel3-HS™ technology to deliver low-light sensitivity in a more compact and power-efficient package."

The OV2735 is currently available for sampling, and is expected to enter volume production in Q1 2017.

Movidius VPU to Appear in Hikvision Smart Cameras

Movidius’ Myriad 2 Vision Processing Unit (VPU) technology will be powering a new lineup of Hikvision smart cameras. “Advances in artificial intelligence are revolutionizing the way we think about personal and public security” says Movidius CEO, Remi El-Ouazzane “The ability to automatically process video in real-time to detect anomalies will have a large impact on the way cities infrastructure are being used. We’re delighted to partner with Hikvision to deploy smarter camera networks and contribute to creating safer communities, better transit hubs and more efficient business operations.”

Thanks to Deep Neural Networks and stereo 3D sensing, Hikvision has been able to achieve up to 99% accuracy in their advanced visual analytics applications. Some of these applications include: car model classification, intruder detection, suspicious baggage alert, and seatbelt detection. The Myriad 2 platform allows these functions to now be processed instantaneously onboard the camera, rather than being sent to the cloud for processing.

“There are huge amounts of gains to be made when it comes to neural networks and intelligent camera systems” says Hikvision CEO, Hu Yangzhong. “With the Myriad 2 VPU we’re able to make our analytics offerings much more accurate, flagging more events that require a response, while reducing false alarms. Embedded, native intelligence is a major step towards smart, safe and efficiently run cities. We will build a long term partnership with Movidius and its VPU roadmap.”

Update: One of the cool looking Hikvision smart cameras with Movidius technology inside:

Framos Compares ON Semi Automotive Sensors

Framos publishes EMVA 1288 comparison of ON Semi older AR0132 and new BSI AR0136 automotive HDR CMOS sensors, both are 1.2MP and 3.75um pixel:

e2v Launches Improved GS Sensors

e2v has launches Emerald family of CMOS sensors featuring what is claimed to be the world’s smallest true global shutter pixel available on the market today (2.8µm). The DSNU of the new sensors is 10 times improved compared to other e2v CMOS products. This allows cameras to perform better in high temperatures and enables long exposures to be used in low-light applications such as microscopes or outdoor cameras for surveillance, speed and traffic applications.

e2v’s Emerald family comprises a 16MP (4096 x 4096 pixels), which is the first to be released, a 12MP (4096 x 3072 pixels) and a 8MP (4096 x 2160 pixels). These high resolution formats are a world first and include a one inch optical format, which can be interfaced with a compact C Mount lens.

Gareth Powell, Marketing Manager for Professional Imaging at e2v, said, “Our new Emerald sensors use advanced CMOS image process technology and pixel design to offer a low noise global shutter pixel, with an electro-optical performance tuned to meet the demanding requirements of the machine vision industry. The sensors deliver Quantum Efficiency of more than 65 %, a full well capacity of over 7ke, a typical temporal noise of 4e- and a new low-noise mode to offer typically around 2e-.”

The whole Emerald family features the same pixel, processing, readout structures and ceramic Land Grid Array (LGA) package to simplify integration, helping to lower development costs for camera makers. The new products have dedicated embedded features including HDR modes, 8/10/12 bit ADCs, high speed outputs (60fps at 10 bits, full 16MP resolution), and a number of power saving modes.

e2v publishes a Youtube video on Emerald features:

The Day The Internet Goes Down

This hasn't happened—yet. But Bruce Schneier, an experienced Internet security expert with a track record of calling attention to little problems before they become big ones, is saying he's seeing signs that somebody may be considering an all-out attack on the Internet. In an essay he posted last month called "Someone Is Learning How to Take Down the Internet," he tells us that several Internet-related companies which perform essential functions such as running domain-name servers (DNS) have come to him recently to report a peculiar kind of distributed denial-of-service (DDOS) attack.

For those who may not have read last week's blog about ICANN, let's back up and do a little Internet 101. The URLs you use to find various websites end in domain names—for example, .com or .org. One company that has gone public on its own with some limited information about the attacks is Verisign, a Virginia-based firm whose involvement with the Internet goes back to the 1990s, when they served as the kind of Internet telephone book for every domain ending in .com for a while, before the ICANN, now an internationally-governed nonprofit organization, took over that job. Without domain-name servers, networked computers can't figure out how to find websites, and the whole Internet communication process pretty much grinds to a halt. So the DNS function is pretty important.

As Schneier explains in his essay, companies such as Verisign have been experiencing DDOS attacks that start small and ramp up over a period of time. He likens them to the way the old Soviet Union used to play tag with American air defenses and radar sites in order to see how good they were, in case they ever had to mount an all-out attack. From the victim's point of view, a DDOS attack would be like if you were an old-fashioned telephone switchboard operator, and all your incoming-call lights lit up at once—for hours, or however long the attack lasts. It's a battle of bandwidths, and if the attacker generates enough dummy requests over a wide enough bandwidth (meaning more servers and more high-speed Internet connections), the attack overwhelms the victim's ability to keep answering the phone, so to speak. Legitimate users of the attacked site are blocked out and simply can't connect as long as the attack is effective. If a critical DNS is attacked, it's a good chance that most of the domain names served will also disappear for the duration. That hasn't happened yet on a large scale, but some small incidents have occurred along these lines recently, and Schneier thinks that somebody is rehearsing for a large-scale attack.

The Internet was designed from the start to be robust against attack, but back in the 1970s and 1980s, the primary fear was an attack on the physical network, not one using the Internet itself. Nobody goes around chopping up fiber cables in hopes of bringing down the Internet, because it's simply not that vulnerable physically. But it's likely that few if any of the originators thought of the possibility that the Internet's strengths—universal access, global reach—would be turned against it by malevolent actors. It's also likely that few of them may have believed in original sin, but that's another matter.

Who would want to take down the Internet? For the rest of the space here I'm going to engage in a little dismal speculation, starting with e-commerce. Whatever else happens if the Internet goes down, you're not going to be able to buy stuff that way. Schneier isn't sure, but he thinks these suspicious probing attacks may be the work of a "state actor," namely Russia or China. Independent hackers, or even criminal rings, seldom have access to entire city blocks of server farms, and high-bandwidth attacks like these generally require such resources.

If one asks the simple question, "What percent of retail sales are transacted over the Internet for these three countries: China, the U. S., and Russia?" one gets an interesting answer. It turns out that as of 2015, China transacted about 12.9% of all retail sales online. The U. S. was next, at about 8.1%. Bringing up the rear is Russia, at around 2%, which is where the U. S. was in 2004. Depending on how it's done, a massive attack on DNS sites could be designed to damage some geographic areas more than others, and without knowing more details about China's Internet setup I can't say whether China could manage to cripple the Internet in the U. S. without messing up its own part. But there is so much U. S.-China trade that Chinese exports would start to suffer pretty fast anyway. So there are a couple of reasons that if China did anything along these lines, they would be shooting themselves in the foot, so to speak.

Russia, on the other hand, has much less in the way of direct U. S. trade, and while it would be inconvenient for them to lose the use of the Internet for a while, their economy, such as it is, would suffer a much smaller hit. So based purely on economic considerations, my guess is that Russia would have more to gain and less to lose in an all-out Internet war than China would.

A total shutdown of the Internet is unlikely, but even a partial shutdown could have dire consequences. Banks use the Internet. Lots of essential utility services, ranging from electric power to water and natural gas, use the Internet for what's called SCADA (supervisory control and data acquisition) functions. The Internet has gradually become critical piece of infrastructure whose vulnerabilities have never been fully tested in an all-out attack. It's not a comfortable place for a country to be in, and in these days of political uncertainty and the waning of dull, expert competence in the upper reaches of government, you hope that someone, somewhere has both considered these possibilities in detail, and figured out some kind of contingency plan to act on in case it happens.

If there is such a plan, I don't know about it. Maybe it's secret and we shouldn't know. But if it's there, I'd at least like to know that we have it. And if we don't, maybe we should make plans on our own for the Day The Internet Goes Down.

Sources: Bruce Schneier's essay "Someone Is Learning How to Take Down the Internet" can be found at https://www.schneier.com/blog/archives/2016/09/someone_is_lear.html. I obtained statistics on the percent of U. S. retail e-commerce sales from the website https://ycharts.com/indicators/ecommerce_sales_as_percent_retail_sales, the China data from https://www.internetretailer.com/2016/01/27/chinas-online-retail-sales-grow-third-589-billion-2015, and the Russia data from https://www.internetretailer.com/commentary/2016/02/08/russian-e-commerce-domestic-sales-slump-chinese-imports-soar. I also referred to the Wikipedia article on Verisign.

Fraunhofer Promises Automotive SPAD-based LiDAR in 2018

Fraunhofer Institute works on SAPD LiDAR for autonomous cars which, in theory, could prevent accidents like Tesla crash:

“A camera’s accuracy depends very much on the lighting available. In this case, it failed. The radar system recognized the obstacle, but couldn’t locate it precisely and mistook the truck for a road sign,” says Werner Brockherde, head of the CMOS Image Sensors business unit at the Fraunhofer Institute for Microelectronic Circuits and Systems IMS in Duisburg.

The researchers have dubbed the new generation of sensors “Flash LiDAR.” They are composed of photodiodes developed at Fraunhofer IMS known as single photon avalanche diodes (SPAD) “Unlike standard LiDAR, which illuminates just one point, our system generates a rectangular measuring field,” Brockherde explains.

“The first systems with our sensors will go into production in 2018,” Brockherde says.

Fraunhofer LiDAR SPAD sensor

ON Semi Powers Light's Multi-Aperture Camera

BusinessWire: ON Semiconductor helps Silicon Valley start-up Light providing its image sensors for L16 multi-aperture camera. Through close collaboration with Light, ON Semiconductor supplies specially customized sensor devices, based on its 1/3.2-inch format AR1335 CMOS sensor product. With up to 10 sensor devices capturing image data simultaneously, Light's L16 camera is supposed to deliver an impressive 52MP resolution, plus over 5X optical zoom without any degradation in image quality.

Meanwhile, Light publishes some info on calibration and alignment of its 16-sensor camera:

"A camera that has one optical path worries less about what is “true” or “real” because there is only one truth, one reality. This reality can be objectively tested and optimized, but it requires adjusting only one path.

A multi-aperture camera with sixteen optical paths (apertures + mirrors + sensors) contends with sixteen realities. In order to merge those realities to create one truth (final image), the camera needs to know precisely where each optical path is relative to the others.

In Light’s Palo Alto office, we’ve been using a specially-designed calibration box to “teach” each L16 prototype where all of its optical paths are relative to the others and relative to the world it will capture. This allows the sixteen paths to behave as one - maintaining the same consistency as a camera with only one optical path."

Light L16 calibration box

engineering information technology

Source of knowledge Engineering and information technology.

Pages