"Chip Superman class specially invited Dr. Li Mengxiong, CEO of Ningbo Huijie Electronic Technology Co., Ltd. to preside over the auto driving social salon. Relevant principals of Renesas electronics, Aixin education, Shanghai Dipu Electronic Technology Co., Ltd., Zhijia technology maxieye, Shanghai angqing microelectronics, Yutai chetong and others discussed auto automatic driving technology with the audience at Camp 895, Zhangjiang building, Shanghai.
The content brought to you is: guests share video and text sorting.
1. Dr. Li Mengxiong, CEO of Zoje electronics, presided over the on-site activities
2. Dr. Xie Zhifeng, Dean of Aixin business school, shared at the opening of the meeting
3. The senior engineer of Renesas Electronics China should share with Yichen
01
Dr. Li Mengxiong of Jinjie electronics presided over the session
Distinguished guests and friends, good morning, I'm Li Mengxiong, CEO of Yujie electronics. Thank you very much for organizing the auto driving technology social salon in the chip Superman classroom. This is a different salon, and we specially emphasize social networking. We want to make today's Salon an open interactive communication platform, so we hope you can actively participate in the interaction later, boldly put forward your opinions, share your views, and even question the guests.
Have you ever thought about what has profoundly changed our way of life in the past 10 to 15 years? I've talked to people about this before. The first idea of many people is the house. However, at that time, I felt that the house was relatively narrow. It was only in line with Chinese characteristics and a characteristic product of the socialist road with Chinese characteristics.
Compared with the house, the mobile phone has profoundly changed our way of life in the past 10 to 15 years. The most important contribution of mobile phones is to bring us back from the era of upright walking to the era of bending walking. Let's look forward to what will profoundly change our lives in the next 10 to 15 years?
We are in an exciting era of great change, and the automotive industry is accelerating from a traditional mechanical industry to an electronic industry. The biggest feature of the electronic industry is full market competition and very fast update and iteration speed. Today, 80% of the innovation comes from automotive electronics and is accelerating in three aspects: electrification, intelligence and networking. Among them, what we most expect is automatic driving.
First of all, let me take a moment to introduce our guests here today. First, Dr. Xie Zhifeng, founder of Aixin business school, President of Aixin business school and professor of microelectronics School of Fudan University; Jiang Lei, the founder and CEO of chip Superman, is called sister Hua in the Jianghu; Ying Yichen, senior engineer of Renesas Electronic Management Co., Ltd; Xia Yu, sales director of Shanghai Zidi Electronic Technology Co., Ltd; Yang Tengfei, co-founder and operation director of Shanghai Zhijia Automobile Technology Co., Ltd; Li Shuang, marketing director of Suzhou Yutai chetong Electronic Technology Co., Ltd; Ye Jin, founder of Suzhou Yutai chetong Electronic Technology Co., Ltd; Wen Li, director of partner system of Ningbo Yijie Electronic Technology Co., Ltd.
Next, let's invite Dr. Xie Zhifeng, a doctor of semiconductor physics at Worcester University, a professor at MIT, a winner of Intel's highest achievement award, one of the founders of SMIC international, and an adjunct professor at the school of microelectronics at Fudan University, to share with us.
02
Aixin education Dr. Xie Zhifeng sharing session
I'm glad to be here. I'd like to share a story with you. I hope you can work together to do a good job in automatic driving. In 1983, I started driving in the United States. I met many dangerous situations and my life safety was on the verge of danger many times.
In the United States, there are many times to drive at night. It is basically quiet and dark between cities. I basically drive from one city to another, and I fall asleep in the middle. After entering the city, the light will be on, and then I will wake up. The whole road is basically half asleep. The next day I didn't remember how to get to this city from the last city. I didn't feel it in the middle of the road. I was afraid when I recalled it, and I had this experience more than once.
Today, the problem can finally be solved. Often we all think that human driving is safer than automatic driving, but from all the statistics, both cars and planes are developing towards automatic driving. Automatic driving has many advantages. It can reduce many accidents and save many lives. I hope you can make sparks at this meeting and talk more and think more in today's salon.
03
Renesas electronics yingyichen sharing link
I'm glad to participate in this activity. I'm Ying Yichen from Renesas electronics, mainly responsible for technical support in ADAS. In this activity, I will mainly introduce ADAS (advanced driving assistance system) and automatic driving solutions, as well as some experience of Renesas electronics in the field of ADAS. My sharing session today is divided into four parts:
1 market trend of automatic driving
2. Ecological environment of Renesas autonomy platform
3 third generation r-car products
4. Renesas electronics tttech cooperation highly automatic driving platform (hadp)
Market trend of automatic driving
First of all, we can take a look at the market trend of ADAS automatic driving direction. As early as 2013, some ADAS related auxiliary technologies have been mass produced and relatively perfect. Many car factories already have ACC, front anti-collision, lane keeping offset, automatic parking, semi-automatic parking and other applications. At present, some applications have been mass produced, and the technology in this regard has been relatively stable.
The current time point is actually the time to integrate and improve many previous functions and tend to mature and develop. Now many high-end cars like Tesla already have automatic driving functions on highways and urban sections. After that, some more complex urban sections will be expanded. Finally, a complete development route of L5 automatic driving may be completed in 2025. Some products of Renesas Electronics will be planned according to the development, put forward corresponding applications and develop corresponding products.
Renesas autonomy platform ecological environment
To this end, Renesas electronics launched this platform called Renesas autonomy. Now the cloud technology is quite hot. Cars will bring some 3G and 4G communication modules to interact with the cloud, so as to obtain some traffic signs and high-low map information to assist vehicle driving.
The most important part of automatic driving is to know the surrounding environment, where pedestrians are and where obstacles are, so as to make the car drive safer, so the perception part is also very important. Get some camera radar data of perception, big data will do some fusion and calculation, so that the car can plan a safer track, and a strong brain is needed to do the function of fusion perception.
Renesas electronics has launched the Renesas autonomy platform to fully cover the autopilot system. Because Renesas autonomy is very complex and there are many directions for automatic driving design, involving many complex algorithms and many sensors, we also cooperate with many friends and partners to improve the system. We have established a relatively perfect ecological environment to deal with some algorithms and sensors.
Now many vehicles are also equipped with a look around system. Look around is actually a relatively simple entry point for automatic driving. Based on the look around system, a lot of work can be done to assist vehicle driving. As before, the relatively simple look around is a 2D look around based on the analog camera, which only allows the driver to see the information around the car from a top view angle. Because the resolution of the analog camera is not very high, it does not provide much information to the driver.
Now gradually switch from analog camera to digital camera, so as to improve the resolution. The pixels on the mobile phone are often 20 million pixels and 30 million pixels, which can take high-quality photos, so it is difficult for people to accept the low resolution of the analog camera. Now, some 1.3 megapixel 720p cameras and even 2 megapixel 1080p cameras are gradually used in the car to obtain higher image quality. This higher image quality is not only a sensory improvement for the driver, but also a lot of auxiliary recognition functions. The identification of lane lines, obstacles around vehicles and pedestrians can also be loaded into the existing look around system.
We have several subdivisions of the look around system. Now the entry-level standard is to make a top view or simple 3D look around. Then do some driving record and object detection functions on the look around system. For example, you can tell the driver that there may be a triangular cone nearby that will affect your parking. More recognition functions may be added later, such as assisted parking with look around. Because the look around system has a good advantage for the original radar based parking, that is, it can see the surrounding environment more clearly.
The original ultrasonic sensor can not perceive the parking frame of the car, but the look around system can understand the surrounding environment based on his vision and know where the parking frame is, so as to better assist the remote parking function. In the future, more expansion may be made in the function of looking around, for example, using the looking around system to make some virtual rear-view mirrors.
Third generation r-car products
Next, I'd like to introduce the third generation r-car products launched by Renesas electronics. However, like Renesas, we have some deep learning acceleration cores and sudden acceleration acceleration cores. Both are Renesas's own IP cores. Some GPUs with better performance will be embedded in them to make better 3D rendering effects. At the same time, we can use Gup to do some computing acceleration. In order to better meet the needs of some HD camera applications, we provide some high bandwidth interfaces.
The above figure is the product line corresponding to our look around system for various levels. Now we mainly promote the third generation products, mainly including r-car v3mv3h and r-car m3 product lines. For some entry-level 3D look around, we can choose r-car v3m coverage. At the same time, v3m is also an application scenario that can do some auxiliary recognition and then semi-automatic driving.
If the performance requirements are relatively high and more identification functions are required, we will provide chips like r-car V3H. If we want better display effect, 3D display effect and good rendering effect, and have strong image recognition and processing ability, we can launch the chip of r-car V3H + r-carm3n. Our next generation products are already under planning. We will combine such applications into a single chip to improve the overall system design.
Now we cooperate with European manufacturers to make a 3D look around scheme. It includes a 3D look around of an external view from any angle of view and a 3D look around with an internal view, which is convenient for the driver to see some information around the car from all corners. The traditional rearview mirror has many blind areas, but it is more convenient to observe around the body through the look around system. At the same time, you can also find some obstacles around the car based on 3D look around.
For the look around, in addition to the most basic display graphics, you may also do an image recognition, that is, the computer vision part. When we parallelize these three processes, we can divide them into a parallel three-way data stream. While doing image recognition, it will not affect the image display effect, and then it will not affect the recording effect. These three applications are completed at the same time to improve the operation efficiency of the system, and then to improve the performance of the system.
If we integrate ISP into the chip for better control, the integration of the system will be better improved. Then you can flexibly support different exposure conditions, resolution and color adjustment on our SOC, and make use of the rear visual acceleration. These are some advantages brought by r-car product integration ISP.
In addition to integrating ISPs, we also integrate some of Renesas's own IP cores to improve the performance of the system. We use our hardware IP core to correct the fisheye distortion. Because many look around systems use wide-angle cameras, which will have some fish eye distortion, which is not very good for the later special effect processing and human visual effect. Therefore, we use hardware to complete distortion correction and optimize power consumption.
The look around system is actually a relatively simple system. In addition to the main control SOC, it will be equipped with a chip to connect four cameras. At the same time, it will also have some storage, including ram and flash and a power management chip to manage the SOC and peripheral hardware power supply, and transmit the look around data to the host or other places for display through the interface, or just voice reminder. For such a system, there will also be many IPS in the chip used. The above figure is a simple entry-level architecture of a look around system.
The structure of high-end look around system is relatively complex. It may have six or eight cameras and add some cameras inside the car. Based on this, we also propose a dual chip matching scheme, which has better display effect and powerful recognition function. In addition to simple look around, such a look around system can also realize some functions of auxiliary parking.
It is still difficult for the perception and judgment part of automatic driving to be a stronger brain. We mainly focus on L2 and L3 levels of mass-produced vehicles, such as semi-automatic parking and some automatic driving application scenarios on highways. We propose a system matching like r-car H3 with r-car v3.
Renesas Electronics - tttech cooperation
High automatic driving platform (hadp)
Because the autopilot system is quite complex, it is also difficult for customers to make use of our new products directly. Therefore, we also propose some evaluation board development kits for customers to use. Renesas electronics has launched a suite, which contains two r-car H3 chips and rh850 MCU to realize L2 and L3 level system verification, so that early evaluation and development can be done.
The suite we developed in cooperation with tttech has the same internal structure as the previous r-drive. It also provides up to 16 camera inputs, multiple Ethernet and KFD interfaces, as well as some interfaces for video input and output.
The advantage of hadp is that the hardware design is a complete vehicle specification level design, and customers can use it to import actual products soon. At the same time, tttech has strong software strength and good Ethernet architecture. Therefore, based on our hardware platform and their software architecture, customers will be more convenient to carry out some upper layer algorithm development and sensor access of autopilot, so as to speed up the development of complex autopilot applications., Read the full text“
Our other product:
