At the "2018 Munich Electronics Exhibition", Ying Yichen, application engineer of Renesas Electronics China automotive electronics ADAS, delivered a speech entitled "solutions for ADAS and automatic driving" at the "China International Automotive Electronics Innovation Technology Conference" held at the same time, introducing Renesas Electronics' solutions and market direction in unmanned driving and advanced assisted driving.
Market trend of automatic driving
Driverless is the trend of market development. In fact, driverless and assisted driving have been applied in existing vehicles. From the basic look around, ACC of expressway has been implemented and applied in many vehicles to improve anti-collision and following ability. As early as the 1990s, there were customized applications on cars. After nearly 30 years of development, the functions of applications have been greatly improved for the original scenes, and gradually made a big step towards the new field of unmanned driving from the aspects of low speed and high speed.
2017 is the development node of the look around system, loading more equipment functions and auxiliary functions to complete remote parking and automatic parking. In terms of high-speed, it will also better identify and control a different application scenario, improve the control accuracy and function of the vehicle, and pave the way for high-level L3, L4 and even L5 in the future. Renesas electronics focuses on these application scenarios, develops and improves corresponding products, and supports current car factories and major first-class suppliers.
Renesas electronic new automatic driving concept
Renesas autonomy was proposed by Renesas electronics ™ Platform, build such a platform for the sensing part, sensor part and vehicle part of ADAS, so that different product applications can be applied to the whole scene of ADAS.
In fact, the algorithm of camera vision is very complex, its ADAS integration is very high, and the safety and reliability requirements of the whole system are also high. Renesas electronics launched r-car alliance based on r-car product series, actively cooperated with major global suppliers such as software, middleware and system integration to build Renesas autonomy ™ Platform, open up the upstream and downstream ecosystem, and provide customers with a more efficient and easy-to-use platform.
Renesas Electronics Global Partners
Market segmentation of the environment vision function
Adas look around is an easy entry point. It has relatively low requirements for the cost and difficulty of the system. It is a more mature auxiliary function in the market. For the entry-level look around, it is a 2D static look around based on the analog camera. The current 3D look around is based on digital high-definition camera, which has been configured in many cars. It will gradually develop into a standard configuration. Based on the latest 3D look around scheme, there will be more auxiliary functions, such as pedestrian recognition and lane line recognition.
For the 3D look around scheme, the performance will be improved by adding more auxiliary functions, recording function during parking, recording some information during vehicle driving, remote automatic parking function, automatic parking assistance function throughout the process, and automatic driving application supporting L2 level.
For the application scenario of looking around, some additional auxiliary functions can be added, such as adding more cameras to monitor the information in the cabin and adding more cameras to observe a wider range. The look around camera can also replace the traditional physical rearview mirror and use the virtual rearview mirror to provide more information for the driver by adding a screen. The above is the segmentation of the look around market.
Advantages of the third generation r-car for the look around market
The latest r-car third-generation product launched by Renesas electronics is for the current rapidly developing ADAS applications. For application scenarios such as look around and automatic parking, Renesas plans to make systematic planning for the third-generation products to provide cost-effective application support.
The third generation product line of r-car is divided into very fine parts. It can provide corresponding support from entry-level to advanced level. It can not only do simple 3D static look around, but also do dynamic look around from any 3D perspective. It can also add more recognition functions on the basis of 3D look around, so as to realize the auxiliary parking function. Customers can select appropriate products and build their own platform according to their required functions. Providing a very flexible solution for the market is also a great advantage of Renesas electronics.
Third generation r-car products for the parking aid market
At present, we will embed some high-performance GPUs according to different display effects to form a 3D rendering of the car body, showing cool effects. The third generation of r-car products also integrate the performance acceleration core for identification, improve the speed of identification function, and realize better driving assistance function.
At present, the look around application has high requirements for display effect. We have adopted a high bandwidth video input interface and introduced a 1.3 million pixel or even 2 million pixel camera to provide excellent performance support for the look around system and auxiliary parking.
The following figure shows the product line planning of Renesas electronics for auxiliary parking and look around system. The purple part is the products that have been mass produced, mainly for the previous analog camera, 2D look around and low-end 3D look around applications. The blue part is the new third-generation product, which provides differentiated products from entry-level to advanced look around application scenarios.
Main advantages of r-car for Parking Aid System
Here we introduce the main advantages of r-car Series in parking system, such as the acceleration core for visual assistance mentioned earlier. R-car series can support function selection, which is a very important part of assisted driving and advanced automatic driving, because these functions will involve control, and the control function will involve the life safety of drivers and passengers. Therefore, we have introduced iso26262 standard into the chip to meet the safety requirements of vehicles and improve the system safety of the whole product.
Renesas electronics verified V3x graphics processing
A jointly developed look around system based on r-car v3m series is displayed on the Renesas booth of Munich Electronics Exhibition. It is a 3D look around scheme that can display any angle of view. In addition, more recognition functions can be added based on this scheme. Our partner cogent embedded can also provide Chinese customers with a certain degree of customized system and do a series of development for different application scenarios.
R-car V3x supports 3-way data flow
R-car v3m is developed for vehicle application scenarios and optimizes the internal architecture of the chip. The standard single look around may only be used to display the look around, and the new functions are difficult to realize. If you need to add a dash cam, you may need to add an external module; If you want to add recognition, you may need more powerful chips. R-car v3m can realize all functions in one chip and realize a parallel operation of three data streams through optimized internal system bus.
What is shown here is the look around effect of parallel processing, which can be synchronously displayed on the screen. This part of video input can also be synchronized to the internal acceleration core for recognition, so as to realize functions such as obstacle recognition, lane line recognition and so on. If you need the functions of driving assistance and driving record, you only need to use the internal video encoder to encode the video, store it in the internal data file, or store it in a public cloud, and watch it on the mobile phone or car machine.
Integrated ISP in the third generation r-car
The most advantage of the third generation products is the integration of ISPs. Most of our competitors use external ISPs. However, through the built-in ISP and calculated by the main control chip, we have greatly improved the image quality. An important feature of the look around system is synchronization. Through the main control chip and built-in ISP, we provide low delay synchronization for camera data, and improve the display effect in brightness, white balance, sequence recognition and so on.
IMR image distortion correction
Because the look around camera generally uses some wide-angle cameras, which may cause fish eye distortion. In order to solve the problem of fisheye distortion, Renesas electronics has added an image distortion correction engine called IMR in R series products, which can use hardware to realize the basic electrical distortion correction of camera without any intervention of CPU. Our IMR engine can also be used to make some 3D splicing effects to replace the CPU to make the same effect calculation.
The above is the total visual IP strategy of Renesas electronics on V3 series.
Renesas computer vision IP strategy
At present, the architectures of many competitive products on the market, such as relying on powerful CPU or GPU for identification and control. Renesas's solution is to embed many acceleration engines to make up for the computing speed and functions of GPU or CPU. GPU may be relatively flexible, but its power consumption is high; The operating efficiency of the CPU is lower than that of the dedicated acceleration core, so we embed a variety of acceleration cores and IP engines in the whole chip, which are specially used for identification. Later, the CNN engine specially used for in-depth learning will be embedded in the new V3 series.
By integrating all hardware acceleration engines and combining CPU and GPU, Renesas electronics provides you with a complete visual processing acceleration scheme.
system architecture
Now let's take a look at the system architecture of the look around application. Because the look around system is relatively simple, it is mainly one of our soc. Four cameras are added and installed at the front or rear end, left end and right end of the car to capture a visual information 360 degrees around the car. A splicing display is provided through some central control chips. Some may also add a common interface to interact with the central control navigation on the body. We will also reserve some interfaces such as Ethernet or can-fd to provide communication related functions.
For the more advanced look around system, we will also input an application scenario such as V3 series and M3 mentioned above. M3 is mainly used for on-board entertainment application scenarios. The performance of visual processing is not as powerful as V3 series. If you need strong and high-precision recognition function, you need to carry out in-depth learning to identify obstacles and its lanes. M3 system is slightly insufficient. It can be matched with a V series product to meet some application scenarios such as auxiliary parking and automatic parking.
As mentioned earlier, our products will have some hardware cores for visual acceleration. Here is an imp engine for visual acceleration. In fact, this imp engine has existed in our product line for a long time. As early as the analog look around chip such as sh7766, there has been an imp engine. Its maturity and functionality have been verified by the market. We have also proposed many optimizations and improvements for this imp engine, which are applied to the latest generation of V3 chips.
This Renesas autonomy ™ In addition to the perception of the camera, we also have fusion and judgment on the platform of the operation surface, which is equivalent to a brain of driverless, making a decision, making some path planning, sensor information fusion and control for the car.
In this regard, we also have similar products. Please see the product roadmap of Renesas electronics. Now we can propose some auxiliary driving such as L2 and L3, general semi-automatic driving with r-car V series chips as an important solution.
Because of its powerful CPU performance, r-car H3 is an eight core chip with four a57 and four A53, which makes its computing performance very powerful. At the same time, it also supports lpddr4 memory, provides a super operating bandwidth for the sensor, and can realize L2 level automatic driving. With such an excellent hardware platform, customers can do a lot of algorithm development on it. If a powerful visual processing screen is needed on the platform, it can be matched with r-car V3 series products as described above.
Our next generation products are also planning for higher-level automatic driving such as L3 and L4, and the CPU core will be improved. At the same time, it will integrate another SOC of V3 vision into the same one for application, and propose such a solution with a chip. At the same time, its functional safety level will be upgraded from the original asil-b level to asil-c or asil-d level to more completely meet the safety requirements of automatic driving.
In the face of such complex application scenarios, it will be difficult for customers to develop their own hardware. Therefore, Renesas electronics has also launched some development kits to carry out advanced development and verification for our customers and interested peers. Two r-car H3 SOCS and one rh850 MCU are integrated into the had solution suite to build this platform. Based on this platform, in addition to doing some advanced algorithm verification and system integration, we will do advanced research to accelerate its import speed for future product import.
We work with third parties to further develop more mature development kits. In cooperation with tttech, hadp platform is developed for your reference. This is jointly developed by us and tttech. They are equipped with their advantageous Ethernet system integration scheme on our hardware platform, which is integrated and provided to customers to accelerate their development., Read the full text, original title: read I ADAS and automatic driving solutions every week
Source: [micro signal: Renesas]_ China, WeChat official account: Renesas electronics, welcome to add attention! Please indicate the source of the article“
Our other product:
