Browse Topic: Driver assistance systems

Items (339)
This SAE Information Report classifies and defines a harmonized set of safety principles intended to be considered by ADS and ADS-equipped vehicle development stakeholders. The set of safety principles herein is based on the collection and analysis of existing information from multiple entities, reflecting the content and spirit of their efforts, including: SAE ITC AVSC Best Practices CAMP Automated Vehicle Research for Enhanced Safety - Final Report RAND Report - Measuring Automated Vehicle Safety: Forging a Framework U.S. DOT: Automated Driving Systems 2.0 - A Vision for Safety Safety First for Automated Driving (SaFAD) UNECE WP29 amendment proposal UNECE/TRANS/WP.29/GRVA/2019/13 On a Formal Model of Safe and Scalable Self-Driving Cars (Intel RSS model) SAE J3018 This SAE Information Report provides guidance for the consideration and application of the safety principles for the development and deployment of ADS and ADS-equipped vehicles. This SAE Information Report is not intended to encompass all aspects of system-level safety for an ADS-equipped vehicle, including communication with other traffic participants. Addressing all identified safety principles is intended to support, but not fully ensure, comprehensive system-level safety. As an SAE Information Report, this document is non-normative, imposes no requirements, and does not address: Requirements for methodology, metrics, and/or acceptance thresholds. Ethics-related safety principles, or any link between the safety principles defined in this document and ethical studies/frameworks. Conformance with safety principles for purposes of liability and/or fault assignment. As ADS technology and deployment are expanded in the future, this document may be reconsidered for future revision including normative requirements.
On-Road Automated Driving (ORAD) committee
Impact of Fog Particles on 1.55 μm Automotive LiDAR Sensor Performance: An Experimental Study in an Enclosed Chamber2021-01-00814/6/2021
To achieve full automation in self-driving vehicles, environmental perception sensing accuracy is critically important. However, ambient particles in adverse weather like foggy, rainy, or snowy conditions can significantly scatter the incident laser beam, and therefore contaminate the intensity and accuracy of light detection and ranging (LiDAR) sensors. Especially compared to the rapidity of technology development in self-driving vehicles, there is a significant lack of documented research on LiDAR systems with wavelength longer than 1 μm for application in Advanced Driver-Assistance Systems. In this work, experimental studies were performed with a state-of-the-art 1.55 μm wavelength automotive-grade LiDAR system in a controlled laboratory fog chamber. The goal of the research is to correlate laser attenuation and the optical properties of fog particles. In this work, a thorough multistep procedure for LiDAR data analysis is presented including spatial averaging of the object measurement and characterizing the temperature effect on a LiDAR intensity parameter. Fog particle density is measured by a commercial visibility sensor instrument. Assuming a constant extinction coefficient and backscatter coefficient, a simple analytical model is derived that correlates LiDAR reflectance and extinction coefficient measured by visibility sensor. Results show that the correlation coefficient between LiDAR and visibility sensor data is 0.98 and the R-squared value of linear fitting is 0.96. By comparing the LiDAR original signal and the model, the Root-Mean-Squared Deviation is 0.007, meaning the model performs very well for predicting LiDAR reflectance in the controlled environment. Furthermore, although the returned signal strength is attenuated, the LiDAR can measure the target with a visibility range lower than six meters.
Zhan, LuNorthrop, William F.
Object Segmentation and Augmented Visualization Based on Panoramic Image Segmentation2021-01-00894/6/2021
Panoramic images can provide critical information for Advanced Driving Assistance Systems (ADAS), such as parking spaces and surrounding vehicles. However, the vehicle in the bird's-eye view image is severely distorted and incomplete, and the visual information becomes very blurred in some illumination insufficient environments. If the driver cannot see the surrounding environment information, the risk of collision will increase, especially during parking. To better percept the local environment with the help of panoramic images, we use panoramic image segmentation results to construct a virtual surround view monitoring system to provide drivers with clearer perception information. Firstly, a lightweight segmentation network is redesigned based on SegNet, which will improve the accuracy of the segmentation without increasing the model’s inference time. Secondly, we build an augment visualization around view monitor (AV-AVM) system with regards to the segmentation results. All necessary segmentation results will be presented as augmented visualization in AV-AVM systems, such as parking slots and road markings. Compared with the traditional panoramic system, the virtual panoramic surround view system we designed can provide the driver with more intuitive environmental perception information and can be further used to construct an automatic parking map.
Liao, JiacaiCao, LiboGong, YipengZhao, JunjieChen, ZhenChen, Kai
Research on Photobiological Safety of Automotive Active Infrared Detection System2021-01-00724/6/2021
The automotive active infrared detection system is usually applied to the night driver assistance system or the diver attention monitoring system. However, the infrared light emitted by the active infrared detection system can cause damage to retina, cornea and eye crystals. This paper has studied the photobiological safety of the infrared light source used in the automotive active infrared detection system. Although it has been already have the general requirements of photobiological safety in international standards, there is not any requirements for automotive active infrared detection system. The range of the active infrared detection system depends on the radiation intensity of the infrared light source, but too much radiation intensity will cause harm to retina, cornea and eye lens when the infrared light source is too close to eyes. Based on the international standards, this paper has analyzed the retinal thermal hazard and the harm to skin and eyes caused by infrared radiation, and it has calculated the theoretical radiation intensity threshold under different risk groups and safety distances. The threshold of radiation intensity of the automotive active infrared detection system have been proposed, which could provide references for the formulation of Chinese national standard. What’s more, the experimental verification has been conducted by using the driver attention monitoring system, and the conclusion indicates that the threshold proposed in this paper is reasonable.
Hu, YueZhu, TongLi, QianYang, Xiong
1.1.201 - A Context Aware Automatic Image Enhancement Method Using Color TransferSAE-PP-002162/1/2021
Advanced Driver Assistance Systems (ADAS) have become an inevitable part of most of the modern cars. Their use is mandated by regulations in some cases; and in other cases where vehicle owners have become more safety conscious. Vision / camera based ADAS systems are widely in use today. However, it is to be noted that the performance of these systems is depends on the quality of the image/video captured by the camera. Low illumination is one of the most important factors which degrades image quality. In order to improve the system performance under low illumination, it is required to first enhance the input images/frames. In this paper, we propose an image enhancement algorithm that would automatically enhance images to a near ideal condition. This is accomplished by mapping features taken from images acquired under ideal illumination conditions on to the target low illumination images/frames. The proposed method consists of four steps a) Pre- processing b) a coarse level segmentation of the input image, c) searching for an appropriate images from the database and d) adaptive color transfer. Since our algorithm performs appropriate adaptive modification to various regions, the quality of resultant image is good even under low illumination condition. We have also done a quantitative evaluation using the entropy and contrast based measures. Results prove that our method performs much better both quantitatively and qualitatively when compared to the standard state of the art image enhancement tools that are widely used.
Mutagaana, Festo
This SAE Information Report provides definitions and discussions of key terms concerning driver drowsiness and fatigue, and basic information on measuring drowsiness and fatigue. It also includes information and concepts for driver drowsiness as they relate to the safe operation of a vehicle. The key driver drowsiness and fatigue causal factors include the following: (1) sleep quality and quantity, (2) time of day, (3) time awake, (4) time on task (modulated by characteristics of the driving task), (5) task-related fatigue (variations of arousal levels related to task underload and overload), and (6) combinations of these factors. Medical conditions, medication, alcohol, or drugs exacerbate drowsiness; however, the discussion in this report is limited to fatigue concepts. This report has two primary outputs: (1) definitions and discussions of key terms concerning driver drowsiness and fatigue, and (2) basic information on measuring drowsiness and fatigue and its effects on the safe operation of a vehicle. These include the physiological and cognitive effects of driver drowsiness and fatigue on driving safety. Examples of effect of driver drowsiness and fatigue on driving safety include those related to vehicle control, operator vigilance (sustained attention), reaction times (object and event detection and response), situational awareness, physiological indicators, subjective assessments, and combinations thereof. For definitions of driving performance measures, refer to SAE J2944. This report applies to all worldwide motor vehicle passenger cars and light trucks, as well as heavy trucks, buses, motorcycles, and mopeds. The intended users of the document are practitioners and researchers in the automotive industry, academia, and other organizations with interest in driver drowsiness and fatigue, driving and driver performance assessment, and road safety.
Driver Metrics, Performance, Behaviors and States Committee
On Perception Safety Requirements and Multi Sensor Systems for Automated Driving Systems2020-01-01014/14/2020
One major challenge in designing SAE level 3-5 Automated Driving Systems (ADS) is to define requirements for the perception system that would enable argumentation for safe operation. The safety requirements on the perception system can only be fulfilled through redundancy in the sensor hardware. It is, however, a challenge to specify the redundancy that is required in the sensor system. Safe operation for an ADS is significantly more difficult compared to advanced driver assistance systems (ADAS). The safety argumentation for ADAS typically argues that in case of a failure in the sensor array a fail-silent behavior is acceptable because the human driver can take control of the vehicle back. This argumentation however is not possible when developing level 4 or higher automation. This paper investigates prerequisites for applying a systematic methodology for analyzing redundancy in a multi-sensor system and the relation to a conceptual ADS functional architecture. This analysis must address the complexity that comes with partially overlapping sensor data from different sensors and considers variations in performance and characteristics due to changes in the environmental conditions. The paper introduces the term incomplete redundancy and presents a systematic methodology for analyzing redundancy. The aim is to provide arguments for how several sensors in a system, when appropriately combined, meet an assigned safety requirement on a higher level. Each sensor will then be assigned a certain responsibility and contributes with a sub-set of information. A set of questions of importance to address as a foundation for such a methodology are defined and discussed. The definitions of redundancy and independence between sensors are discussed as well as contract-based functional safety to adapt to different environmental and operating conditions.
Cassel, AndersBergenhem, CarlChristensen, Ole MartinHeyn, Hans-MartinLeadersson-Olsson, SusannaMajdandzic, MarioSun, PengThorsén, AndersTrygvesson, Jörgen
Analysis of LiDAR and Camera Data in Real-World Weather Conditions for Autonomous Vehicle Operations2020-01-00934/14/2020
Autonomous vehicle technology has the potential to improve the safety, efficiency, and cost of our current transportation system by removing human error. With sensors available today, it is possible for the development of these vehicles, however, there are still issues with autonomous vehicle operations in adverse weather conditions (e.g. snow-covered roads, heavy rain, fog, etc.) due to the degradation of sensor data quality and insufficiently robust software algorithms. Since autonomous vehicles rely entirely on sensor data to perceive their surrounding environment, this becomes a significant issue in the performance of the autonomous system. The purpose of this study is to collect sensor data under various weather conditions to understand the effects of weather on sensor data. The sensors used in this study were one camera and one LiDAR. These sensors were connected to an NVIDIA Drive Px2 which operated in a 2019 Kia Niro. Two custom scenarios (static and dynamic objects) were chosen to collect sensor data operating in four real-world weather conditions: fair, cloudy, rainy, and light snow. An algorithm developed herein was used to provide a method of quantifying the data for comparison against the other weather conditions. The results from these performance algorithms show that sensor data quality degrades by an average of 13.88% for static objects and 16.16% for dynamic objects while operating in these conditions, with operations in rain proving to have the most significant effect on sensor data degradation. From this study, it is hypothesized that advancements in data processing algorithms can improve the usability of this degraded data. In future work, we seek to explore fault-tolerant sensor fusion algorithms that can overcome the effects of adverse weather.
Goberville, NickEl-Yabroudi, MohammadOmwanas, MarkRojas, JohanMeyer, RickAsher, ZacharyAbdel-Qader, Ikhlas
Driver Drowsiness Behavior Detection and Analysis Using Vision-Based Multimodal Features for Driving Safety2020-01-12114/14/2020
Driving inattention caused by drowsiness has been a significant reason for vehicle crash accidents, and there is a critical need to augment driving safety by monitoring driver drowsiness behaviors. For real-time drowsy driving awareness, we propose a vision-based driver drowsiness monitoring system (DDMS) for driver drowsiness behavior recognition and analysis. First, an infrared camera is deployed in-vehicle to capture the driver’s facial and head information in naturalistic driving scenarios, in which the driver may or may not wear glasses or sunglasses. Second, we propose and design a multi-modal features representation approach based on facial landmarks, and head pose which is retrieved in a convolutional neural network (CNN) regression model. Finally, an extreme learning machine (ELM) model is proposed to fuse the facial landmark, recognition model and pose orientation for drowsiness detection. The DDMS gives promptly warning to the driver once a drowsiness event is detected. The proposed CNN and ELM models are trained in a drowsy driving dataset and are validated on public datasets and field tests. Comparing to the end-to-end CNN recognition model, the proposed multi-modal fusion with the ELM detection model allows faster and more accurate detection with minimal intervention. The experimental result demonstrates that DDMS is able to provide real-time and effective drowsy driving alerts under various light conditions to augment driving safety.
Li, RuiBrand, HowardGopinath, AdityaKamarajugadda, SrivatsavYang, LiangWang, WeitianLi, Bing
Perceptions of Two Unique Lane Centering Systems: An FOT Interview Analysis2020-01-01084/14/2020
The goal of this interview analysis was to explore and document the perceptions of two unique lane centering systems (S90’s Pilot Assist and CT6’s Super Cruise). Both systems offer a similar type of functionality (adaptive cruise control and lane centering), but have significantly different design philosophies and HMI (Human-Machine Interface) implementations. Twenty-four drivers drove one of the two vehicle models for a month as part of a field operational test (FOT) study. Upon vehicle return, drivers took part in a 60-minute semi-structured interview covering their perceptions of the vehicle’s various advanced driver-assistance systems (ADAS). Transcripts of the interviews were coded by two researchers, who tagged each statement with relevant system and perception code labels. For analysis, the perception codes were grouped into larger thematic bins of safety, comfort, driver attention, and system performance. Perceptions of adaptive cruise control (ACC) were similar across vehicles. Almost all participants mentioned benefits of comfort and safety associated with ACC use. Participants cited different benefits between the two vehicle’s implementations of lane centering. A majority of participants (75%) described comfort benefits associated with Super Cruise, while less than half (41%) cited comfort benefits associated with Pilot Assist. Only a few participants (25%) mentioned safety benefits associated with Super Cruise. Half (50%) of the participants mentioned safety benefits associated with Pilot Assist. Almost all participants cited fears of potential misuse of the system in which drivers might pay less attention to the driving task. Results suggest that drivers’ comprehension and expectation of these systems’ behavior are strongly influenced by their design philosophies, specifically in terms of the difference in hands-on versus hands-off-wheel implementation. The perceived role of the driver – as either a fallback driver or as an assisted driver - may be influenced by the design implementation.
Landry, StevenSeppelt, BobbieRusso, LucaMehler, BruceAngell, LindaGershon, PninaReimer, Bryan
Intention-aware Lane Changing Assistance Strategy Basing on Traffic Situation Assessment2020-01-01274/14/2020
Traffic accidents avoidance is one of the main advantages for automated vehicles. As one of the main causes of vehicle collision accidents, lane changing of the ego vehicle in case that the obstacle vehicles appear in the blind spot with uncertain motion intentions is one of the main goals for the automated vehicle. An intention-aware lane changing collision assistance strategy basing on traffic situation assessment in the complex traffic scenarios is proposed in this paper. Typical Regions of Interest (ROI) within the detection range of the blind spots are selected basing on the road topology structures and state space consisting of the ego vehicle and the obstacle vehicles. Then the motion intentions of the obstacle vehicles in ROI are identified basing on Gaussian Mixture Models (GMM) and the corresponding motion trajectories are predicted basing on the state equation. Traffic situation is assessed according to the index of the motion intentions and the coupling tendency between the ego vehicle and the obstacle vehicles and the risk level is graded basing on the map with collision time. Lane keeping assist is carried out according to the assessment result of the traffic situation. Testing scenarios with the straight road and T-junction are designed and a co-simulation environment consisting of CarMaker and Mathwork Simulink is established to verify the proposed strategy in complex traffic scenes. Simulation results present an adaptive ROI and a high identification accuracy for motion intentions of the obstacle vehicles. What’s more, it shows that the traffic situation can be accurately evaluated and the ego vehicle can be effectively controlled with the appearance of the high-risk vehicles.
Wu, JianLiu, SihanHe, RuiSun, Bohua
The Design of Safe-Reliable-Optimal Performance for Automated Driving Systems on Multiple Lanes with Merging Features2020-01-01224/14/2020
Safety function for automated driving systems including advanced driver assistance systems and autonomous vehicle systems is very important. Inside safety function, predictive judge sub-function should be designed with the consideration of more and more penetration of automated driving vehicles. This paper presents the design on multiple lanes with merging features based on the author's previous Patent JP2019-147944 using predictive time-head-way and time-to-collision maps. In the author's previous work (Model Predictive Control for Hybrid Electric Vehicle Platooning Using Slope Information-Published on IEEE Transactions on Intelligent Transportation Systems), a model predictive control framework was designed. Due to the difficulty to detail the sub-safety function deeply with merging features, few works are found to deal with sensor platforms focusing on rear side, and situations of merging lane side with the consideration of relative relation variations with other vehicles and road border markers. However, performance enhancement is needed assuring 100% safety-reliability-optimality and single-objectivity. Also, platforms of on-board sensors including side and rear view are needed to deal with false negative operations and false positive operations. The optimal operation line model of human factors is designed based on time-head-way (reliability), time-to-collision (safety), and combinations of time-head-way and time-to-collision (optimality). The general theory of model predictive control is used to find the target. The model based methodology is applied to solve the human factor model of risk feeling based on only time-head-way and time-to-collision for the human reaction and acceptance metric. Experimental results validated the effectiveness of the proposed approach. The model parameters can be calibrated internationally by tuning the metric of cooperativeness. The target of the predictive judge sub-function is to move the operation point to the specified area. The predictive judge sub-function on high level is decisive for regulation control to move the operation point from difficult areas to the target area in future.
Yu, Kaijiang
Obstacle Avoidance Using Model Predictive Control: An Implementation and Validation Study Using Scaled Vehicles2020-01-01094/14/2020
Over the last decade, tremendous amount of research and progress has been made towards developing smart technologies for autonomous vehicles such as adaptive cruise control, lane keeping assist, lane following algorithms, and decision-making algorithms. One of the fundamental objectives for the development of such technologies is to enable autonomous vehicles with the capability to avoid obstacles and maintain safety. Automobiles are real-world dynamical systems - possessing inertia, operating at varying speeds, with finite accelerations/decelerations during operations. Deployment of autonomy in vehicles increases in complexity multi-fold especially when high DOF vehicle models need to be considered for robust control. Model Predictive Control (MPC) is a powerful tool that is used extensively to control the behavior of complex, dynamic systems. As a model-based approach, the fidelity of the model and selection of model-parameters plays a role in ultimate performance. Hardware-in-the-loop testing of such algorithms can often prove to be complex in its design as well as in its implementation. Therefore, in this paper, we explore a less-used deployment toolchain that combines the power of ROS (Robot Operating System) for intra-robot communication with motors and sensors with the rich library of controller models in Simulink Real-Time. In particular we explore this rapid-control-prototyping in real-time to deploy Model Predictive Control for Obstacle Avoidance on a ROS-based scaled-vehicle. We found that this framework is user-friendly and contains great potential for educational and research-bed deployments - with a short development and deployment time that can fit neatly in one semester.
Bulsara, ArdashirRaman, AdhitiKamarajugadda, SrivatsavSchmid, MatthiasKrovi, Venkat N
Decision Making and Trajectory Planning for Lane Change Control Inspired by Parallel Parking2020-01-01344/14/2020
Lane-changing systems have been developed and applied to improve environmental adaptability of advanced driver assistant system (ADAS) and driver comfort. Lane-changing control consists of three steps: decision making, trajectory planning and trajectory tracking. Current methods are not perfect due to weaknesses such as high computation cost, low robustness to uncertainties, etc. In this paper, a novel lane changing control method is proposed, where lane-changing behavior is analogized to parallel parking behavior. In the perspective of host vehicle with lane-changing intention, the space between vehicles in the target adjacent lane can be regarded as dynamic parking space. A decision making and path planning algorithm of parallel parking is adapted to deal with lane change condition. The adopted algorithm based on rules checks lane-changing feasibility and generates desired path in the moving reference system at the same speed of vehicles in target lane. Compared to algorithm for static parking space, the uncertainty of the space between moving vehicles and host vehicle dynamics raises stricter requirements for algorithms. Works are conducted to deal with dynamically changing scenarios, such as design of safety zone and exit conditions to avoid collision. Simulation under PreScan-Simulink environment shows that the proposed method outperforms in lane change scenarios and achieves strong robustness to inter-vehicle dynamics.
Yu, LiangyaoRu, ZeLu, ZhenghongLiang, GuanqunXiong, CenboLanie, AbiWang, Ruyue
Data-Driven Confidence Model for ADAS Object Detection2020-01-06954/14/2020
The majority of road accident is due to human error. Advanced Driver Assistance System (ADAS) has the potential to reduce human error and improve driving safety. Customers have shown a growing acceptance for ADAS technology. With the rising demand for safety and comfortable driving experience, the global market for ADAS is expected to grow to $67 billion by 2025. A reliable ADAS system requires an accurate and robust object-detection system. There is often a trade-off in tuning the system. On one hand, miss-detection can cause accidents; on the other hand, false-detection can result in ghost-braking and harm the driving experience. The ADAS system can access various information from different sources. However, a unified confidence model, which combines different indicators, has not been much studied in the literature. In this paper, we propose a data-driven method, which utilizes the features from radar, camera and the tracking system to produce a high-level confidence model. In addition, different regions regarding the ego vehicle usually have different emphases for detection error based on the system design requirements. And therefore, we can tune towards the design requirements by change the threshold of the classifier based on the region of interest. The proposed method was validated with real-world driving data and shown a better performance based on the design requirement of the Adaptive Cruise Control (ACC) and Autonomous Emergency Braking (AEB) functions.
Yang, HangZhang, DaruiWang, DaihanZhou, Jianguang
Secure Vehicular Communication Using Blockchain Technology2020-01-07224/14/2020
The cars we drive are rapidly transforming. Connected vehicles in the context of the Advanced Driver Assistance System or Autonomous Vehicles are about to change the way we drive cars. Connected Vehicles are futuristic vehicles that can interact with other vehicles for passing on information such as, mapping and localization, information about road traffic and driving behaviour. However, such vehicles, particularly the autonomous ones, are prone to a variety of attacks including cyber-attacks. These malicious attacks can intrude a vehicle that not only endangers the vehicles safety, but also the life of passengers and the nearby environment. Thus, identifying and eliminating these attacks for providing a secure communication environment is of great need. Also, all the existing methods for vehicular communication rely on a centralized server which itself invite massive cyber-security threats. These threats and challenges can be addressed by using the Blockchain (BC) technology, where each transaction is logged in a decentralized immutable BC ledger. In this work, we show how BC can facilitate communication between connected vehicles to send and receive information while assuring the security of all the vehicles participating in the BC network. First, we developed an application for the blockchain based less-complex Proof-of-Work consensus method that allows the vehicles to transfer information in a secured manner. Second, we demonstrate the working of the application using raspberry pi board that act as vehicles mounted with sensors and two computers that act as blockchain network. Finally, we discuss the advantages and disadvantages of blockchain based vehicular communication and the integration of the blockchain with VANET as well.
M, Vidya KrishnanKoduri, RajeshNandyala, SivaprasadManalikandy, Mithun
Runtime Active Safety Risk-Assessment of Highly Autonomous Vehicles for Safe Nominal Behavior2020-01-01074/14/2020
Fatal crashes involving automated driving systems, has been raising the concern of minimum standard requirement for safety, reliability and performance required for Autonomous Driving System (ADS)/Advanced Driver Assistance System (ADAS) before this cutting-edge technology takes on public roads. Hence, in order to ensure necessary safety requirements of ADS/ADAS systems we propose a runtime active safety assurance module known as SConSert. SConSert performs dynamic risk assessment of “Sensing, Planning and Action module of ADS/ADAS”; to provide minimal risk maneuver in any given driving scenario. The dynamic risk assessment of ADS/ADAS system is based on the operational design domain (ODD) knowledge of the driving scenario plus the sensor capability, ADS/ADAS algorithm requirement and capability, and finally smooth and collision free maneuver requirement. So, the main concept behind SConSert is runtime derivation of situational and conditional set of contracts for a given driving scenario and ADS/ADAS system ODD; fulfillment or violation of which can help in runtime dynamic risk assessment of ADS/ADAS to plan minimal safe behavior such that necessary safety requirements can be achieved. Finally, through experiment we show that proposed runtime active assurance safety module can handle complex driving scenario, and present simulation and experimental results that emphasizes the importance of the proposed runtime safety assurance module and shows that the proposed system is capable of performing runtime dynamic risk assessment in order to keep the automated driving systems always within the safe sate that is the automated driving system always perform within its ODD.
Rathour, Swarn SinghIshigooka, TasukuOtsuka, SatoshiMARTIN, RAUL
Reference Test System for Machine Vision Used for ADAS Functions2020-01-00964/14/2020
Advanced Driver Assistance Systems (ADAS) like Lane Departure Warning (LDW) and Lane Keep Assist (LKA) have been available for several years now but has experienced low customer acceptance and market penetration. These deficiencies can be traced to the inability of many of the perception systems to consistently recognize lane markings and localize the vehicle with respect to the lane markings in the real-world with poor markings, changing weather conditions and occlusions. Currently, there is no available standard or benchmark to evaluate the quality of either the lane markings or the perception algorithms. This work seeks to establish a reference test system that could be used by transportation agencies to evaluate the quality of their markings to support ADAS functions that rely on pavement markings. The test system can also be used by designers as a benchmark for their proprietary systems. To support this development, an extensive video dataset was collected at different times of day and weather conditions on various roads in Central Texas. The videos were evaluated on different state-of-the art lane detection algorithms and their performance was ranked based on a set of metrics specifically developed for evaluating the effectiveness of the lane estimation system. The test scenarios are comprised of a set of roadways and environmental features, as well as the pavement marking presence and luminance variables. A systems approach is presented by correlating the algorithm performance data to the environmental factors, lane marking types, color, material, and the retroreflectivity of pavement markings.
Nayak, AbhishekRathinam, SivakumarPike, AdamGopalswamy, Swaminathan
Evaluation of Methods for Identification of Driving Styles and Simulation-Based Analysis of their Influence on Energy Consumption on the Example of a Hybrid Drive Train2020-01-04434/14/2020
Due to current progresses in the field of driver assistance systems and the continuously growing electrification of vehicle drive trains, the evaluation of driver behavior has become an important part in the development process of modern cars. Findings from driver analyses are used for the creation of individual profiles, which can be permanently adapted due to ongoing data processing. A benefit of data-based dynamic control systems lies in the possibility to individually configure the vehicle behavior for a specific driver, which can contribute to increasing customer acceptance and satisfaction. In this way, an optimization of the control behavior between driver and vehicle and the resulting mutual system learning and -adjustment hold great potential for improvements in driving behavior, safety and energy consumption. The submitted paper deals with the analysis of different methods and measurement systems for the identification and classification of driver profiles as well as with their potential to optimize both vehicle driving behavior and energy consumption on the example of a hybrid drive train. A literature research results in a number of different approaches of evaluation, which are analyzed, linked and adapted in the publication. As a result, an evaluation of the connection between different methods of driver profile determination is given. Data collection and interviews have been performed during twenty test drives on a defined route profile with different measurement systems and methods. The acquired data form the basis for a comparison and an analysis of a comprehensive driving style classification. Subsequently, a framework for computer-aided investigations of the influences of driver behavior on the control of drive trains is established by use of an existed simulation model of a hybrid drive train. Finally, a driver model is implemented based on the learnings out of analyzing the measurements and surveys. The evaluation of the measurement campaigns delivers detailed information about vehicle longitudinal acceleration behavior in different driving scenarios. This information is used to classify the individual driving styles into the types calm, normal and aggressive. This driving style-related information can be integrated into the control strategy of a hybrid power train to support operation strategy optimization regarding both driver satisfaction and reduction of energy-, respectively fuel consumption.
Domijanic, MarkoHirz, MarioPucher, Gregor
GNSS-Based Lane Keeping Assist System Using Model Predictive Control and Time Delay Compensation2020-01-10234/14/2020
In recent decades, research and development in the field of autonomous vehicles have rapidly increased throughout the world, and autonomous driving technologies have begun to be applied to mass production vehicles. Especially recently, even affordable mass production vehicles have begun to be equipped with some autonomous driving systems such as a Lane Keeping Assist (LKA) system. In general, mass-produced LKA systems use a lane detection camera as a means of keeping the lane. One of the common limitations of camera-based LKA systems is that the lane keeping performance significantly decreases when the camera cannot detect lane markings for various reasons such as snow coverage or blurred lane markings. To overcome this limitation, we have developed Global Navigation Satellite System (GNSS)-based LKA systems, which are not affected by the surrounding environment such as weather and the condition of lane markings. In our latest study, we applied Model Predictive Control (MPC) to our GNSS-based LKA system so as to enhance lane-keeping performance. We then revealed that the GNSS-based LKA system with MPC had low robustness regarding the time delay of a GNSS and that countermeasures for the time delay were necessary. In this paper, we apply Smith predictor-like Time Delay Compensation (TDC) to compensate for the time delay. The TDC predicts the current state variables from the past sensor signals based on the vehicle dynamics. We demonstrate that the TDC stabilizes the LKA system even when the GNSS has a time delay in a simulation. Furthermore we add another TDC to compensate for the time delay of Electrical Power Steering (EPS) with the aim of reducing the oscillation of the steering wheel angle. Finally, we evaluate the lane keeping performance in a real-vehicle experiment on a snow-covered highway.
Tominaga, KentaTakeuchi, YuKitano, HiroakiTomoki, UnoQuirynen, RienCairano, Stefano
Prevention of Snow Accretion on Camera Lenses of Autonomous Vehicles2020-01-01054/14/2020
With the rapid development of artificial intelligence, the autonomous vehicles (AV) have attracted considerable attention in the automotive industry. However, different factors negatively impact the adoption of the AVs, delaying their successful commercialization. Accretion of atmospheric icing, especially wet snow, on AV sensors causes blockage on their lenses, making them prone to lose their sight, in turn, increasing potential chances of accidents. In this study, two different designs are proposed in order to prevent snow accretion on the lenses of AVs via air flow across the lens surface. In both designs, lenses made of plain glass and superhydrophobic coated glass surfaces are tested. While some researchers have shown promise of water repellency on superhydrophobic surfaces, more snow accretion is observed on the superhydrophobic surfaces, when compared to the plain glass lenses. In the experiments, snow is formed using a novel snow gun inside a walk-in cold room connected to a wind tunnel that can reach wind speeds of up to 40 mph. It is observed that the air flow over the lens significantly reduces the accretion of snow on the lens and could maintain the lens clean for up to 20 mph wind velocities. However, at LWC values of approximately 28%, the stickiness of the snowflakes increases, enhancing snow accretion on the lenses and translating to significant loss of sight. The high stickiness of the snowflakes along with high wind speeds leads to increased blockage of the AV lenses.
Mohammadian, BehrouzSarayloo, MehdiHeil, JamieSojoudi, HosseinRobertson, MichaelHong, HaipingTran, TommyPatil, SunilKrishnan, Venkatesh
Robust Sensor Fused Object Detection Using Convolutional Neural Networks for Autonomous Vehicles2020-01-01004/14/2020
Environmental perception is considered an essential module for autonomous driving and Advanced Driver Assistance System (ADAS). Recently, deep Convolutional Neural Networks (CNNs) have become the State-of-the-Art with many different architectures in various object detection problems. However, performances of existing CNNs have been dropping when detecting small objects at a large distance. To deploy any environmental perception system in real world applications, it is important that the system achieves high accuracy regardless of the size of the object, distance, and weather conditions. In this paper, a robust sensor fused object detection system is proposed by utilizing the advantages of both vision and automotive radar sensors. The proposed system consists of three major components: 1) the Coordinate Conversion module, 2) Multi level-Sensor Fusion Detection (MSFD) system, and 3) Temporal Correlation filtering module. The proposed MSFD system employs the principles of artificial intelligence beyond simple comparison of data variance of the sensors. And then, its performance is further improved by using the temporal correlation information with an adaptive threshold scheme. The proposed system is evaluated with the collected video data (6,854 image frames with 18,918 labeled objects). Based on the laboratory testing and in-vehicle validation, the proposed system demonstrates its high accuracy for detecting any size of objects in real-world data.
Park, JungmeJayachandran Raguraman, SriramAslam, AakifGotadki, Shruti
Virtual Assessment of Automated Driving: Methodology, Challenges, and Lessons Learned12-02-04-002012/18/2019
Automated driving as one of the most anticipated technologies is approaching its market release in the near future. Since several years, the research in the automotive industry is largely focused on its development and presents well-engineered prototypes. The many aspects of this development do not only concern the function and its components itself, but also the proof of safety and assessment for its market release. It is clear that previous methods used for the release of Advanced Driver Assistance Systems are not applicable. In contrast to already released systems, automated driving is not restricted to a certain field of application in terms of driving scenarios it has to take action in. This results in an infeasible amount of required testing and unforeseeable scenarios the function can face throughout its lifetime. In this article, we show a scenario-based approach that promises to overcome those challenges. In contrast to previous methods, it includes virtual test domains in a verified way to diminish the demand for real-world testing. Local verification of certain scenarios from real-world testing enables virtual variation in a local test space, and thus contributes to the test volume. The approach is implemented, evaluated, and shows first promising results. An intentional evaluation against a corner case-a scenario where the use of virtual test domains is challenged-from the set of scenarios reveals current weak spots. These are transformed into lessons learned, proposed solutions, and future work for enhancements. With the aid of these, the suggested methodology is a promising candidate to overcome the challenges of evaluating automated driving functions.
Wagner, SebastianKnoll, AloisGroh, KorbinianKühbeck, ThomasWatzenig, DanielEckstein, Lutz
Over the last 100 years, the automobile has become integrated in a fundamental way into the broader economy. A broad and deep ecosystem has emerged, and critical components of this ecosystem include insurance, after-market services, automobile retail sales, automobile lending, energy suppliers (e.g., gas stations), medical services, advertising, lawyers, banking, public planners, and law enforcement. These components - which together represent almost $2 trillion of the U.S. economy - are in equilibrium based on the current capabilities of automotive technology. However, the advent of autonomous vehicles (AVs) and technologies like electrification have the potential to significantly disrupt the automotive ecosystem. The critical cog governing the rate and pace of this shift is the management of the test and verification of AVs. In this SAE EDGE™ report, six senior industry leaders in the impacted ecosystems essay articles which describe sectors of the current automotive ecosystem and the manner in which AV technology can potentially reshape them - providing a mosaic of the massive infrastructure shifts which will be required to absorb AV technologies. NOTE: SAE EDGE™ Research Reports are intended to identify and illuminate key issues in emerging, but still unsettled, technologies of interest to the mobility industry. The goal of SAE EDGE™ Research Reports is to stimulate discussion and work in the hope of promoting and speeding resolution of identified issues. SAE EDGE™ Research Reports are not intended to resolve the issues they identify or close any topic to further scrutiny. Click here to access the full SAE EDGETM Research Report portfolio.
Razdan, Rahul
Analysis of Accelerator Hardware for Autonomous Vehicles and Data Centers2019-01-261510/22/2019
The development of Autonomous Vehicles (AV) has become a popular subject in academia and industry. Companies and cities are quickly realizing the opportunities that AVs can generate from Mobility as a Service to traffic safety. The challenges for the infrastructure to incorporate AVs as a viable transportation source are immense, from an outdated infrastructure to radical Smart-City designs. Historically, the transportation infrastructure has faced challenges from underfunding, economics, and much needed improvements. With the current infrastructure unable to support many of the services required by a fully connected network, a transformation will be necessary to meet growing mobility needs. The role of accelerating technology in data centers are key for production operations among industry leaders such as Amazon and Microsoft for real-time processing. The same accelerating technology that has successfully impacted data centers will play the same role in much smaller micro data centers (mDC) for Smart-City design in the transportation infrastructure. These mDCs and Edge computing sites will be tasked with the latency, tasking caching and offloading (TCO), and processing of millions of connected vehicles simultaneously. With the recent upgrade of 5G from 4G wireless connectivity will invariably provide lower latency to Edge computing devices used in real-time applications. This paper provides an analysis of accelerator technology for real-time processing in the transportation infrastructure. Accelerator hardware such as FPGAs, GPUs, and ACISs will be highlighted from current research that support real-time capabilities. As the popularity of AVs and a connected network continues to grow, the role of accelerator technology will enable large scale real-time processing in AVs and the transportation infrastructure.
Brown, Kyle W.
An ADAS Feature Rating System: Proposing a New Industry Standard2019-24-025110/7/2019
More than 90% of new vehicles include Advanced Driving Assistance Systems that offer features such as Lane Keep Assist and Adaptive Cruise Control [1]. These ever-improving vehicle systems present a great opportunity to increase driving safety and reduce the number of roadway deaths and injuries. Indeed, they are already having a positive effect. However, the wide variety of features offered in the marketplace can be confusing to consumers, who may not clearly understand their vehicles’ true capabilities and limitations, or have an easy way of comparing system performance between vehicle models. This lack of information has the potential to reduce the safety gains of ADAS features by increasing the risk of improper use. To encourage transparency in the marketplace and thus engender the maximum positive effect of ADAS technologies, this paper proposes a five-level rating system, which utilizes diamonds to denote significant milestone achievements in vehicle system performance. The rating charts resulting from this system describe gradients of performance within criteria addressed by certain foundational ADAS features. Presented here in its initial stage of development, this rating system will require continued refinement. We therefore encourage the community of automotive safety organizations to take up the mantle by establishing and performing test protocols for assigning standardized ADAS feature performance ratings. We believe that the result of this effort, a common method for understanding and comparing ADAS performance, promises to deliver a beneficial level of clarity to the industry and consumers.
Heeren, DavidGradu, Mircea
Items per page:
1 – 50 of 339