Sony’s new image sensor makes the camera smarter thanks to the integrated AI

Tram Ho

For many years, the evolution of image sensors mainly revolved around how to cram as many pixels as possible, and how to reduce their size to equip devices. increasingly more compact and thinner. The next evolutionary step? Image sensor will become smarter.

Right. Today, Sony has unveiled the IMX500 and IMX 501, two 12.3-megapixel sensors with integrated AI processing chips. They will be able to handle “light” machine learning tasks – such as identifying a stray dog ​​or cat in your backyard – without the help of external hardware, as well as without sending any video to the cloud or other systems. Instead, they can send pings that contain anonymous metadata to notify you of what they have just seen.

At first glance, things may not seem very appealing, but according to Mark Hanson, Sony’s vice president of Business and Technology Innovation, the integrated AI chip will make the camera much more useful. First, this is considered to be a solution to better ensure the privacy of users, because sensors can fully handle AI tasks right on the device – an issue of particular concern at Europe, where new GDPR laws have been severely restricting the use of surveillance videos by institutions. The closer the data is to the source device.

Cảm biến hình ảnh mới của Sony sẽ giúp camera thông minh hơn nhờ AI tích hợp - Ảnh 1.

Integrated AI also means you can get processed information in real time. A camera in front of a store can count the number of people walking in, and even issue a security warning if someone doesn’t wear a mask (a major medical risk during the COVID-19 pandemic). rife). Another camera can track the number of items on the shelf, while other cameras can track customer foot traffic to identify “hot spots” that many people visit when shopping.

Of course, these image sensors will not replace sophisticated cloud machine learning tools, which can do more than just identify objects. But they are still a big step toward a future where cameras can act as miniature computers.

And they can also support complex computer vision systems. For example, in a cashierless store like Amazon’s, where tons of video data is collected and processed every day by a series of security cameras, Sony sensors can accurately detect those where the customers are standing. If no one is standing by the milk stand, there’s no reason to turn the 3D cameras there, right?

Hanson says that the IMX500 test versions have been shipped to Sony partners, while IMX501, which is packaged to fit on devices like smart boards, will begin shipping in June. next. We are likely to see new hardware devices later this year and throughout 2021.

Reference: Engadget

Share the news now

Source : Genk