Sae Top Tec IV Overview

Intelligent Vehicles:A New World Coming..Presentation to SAE In-Car Electronics and Telematics TOPTECSeptember 21, 2000

Richard BishopRichard Bishop Consulting

www.ivsource.net

IVs: This Joint is Jumpin.During/After Crash Technology Evolving Telematics is explodingInformation Layer -- in-vehicle informationDriver Assistance systems entering marketControl Layer -- helps driver drive more safely, productively, efficientlyAutomated Driving -- ongoing developmentResults from significant activity in trucks, buses, special vehicles can flow to the passcar platform

IV Activity Worldwide: The PlayersAutomotive / truck OEMs and suppliers worldwidePublicly-funded programs in Asia, Europe, North America

IV Players Worldwide: North America USDOT Intelligent Vehicle Initiative Goal: accelerate the deployment of near-term safety systems for cars, heavy trucks, buses, specialty vehiclesCost-shared projects initiated in 1999 with truck OEMs and state DOTsPre-competitive research projects being negotiated with carmakersAmbitious Safety Goals: example -- 50% reduction in heavy-truck related fatalities within ten yearsFederal Transit Administration Bus Rapid Transit programUSDOD: autonomous military vehiclesUniversity research: California PATH, U. of Minnesota, Ohio State University

IV Players Worldwide: AsiaJapanAdvanced Cruise-Assist Research Association (AHSRA) very active (Ministries of Construction and Transportation)Japans Ministry of International Trade and Industry (MITI) performing advanced workActivity also in Korea, SingaporeIndustrial automation in Australia

IV Players Worldwide: EuropeEuropeEuropean Commission projects 5th Framework Research ProgramProjects include public and private sector participants from major countriesNational level programs in France, Netherlands, SwedenResearch in Italy, Germany, UK

Driver Assistance SystemsNight VisionAdaptive Cruise ControlCollision WarningCollision AvoidanceDriver Impairment MonitoringAdvanced Driver AssistanceCooperative InfrastructureAutomated Driving

Driver Assistance Systems:Night Vision

DeVille 2000 With Night Vision

Driver Assistance Systems: Adaptive Cruise ControlACC: Foot-free drivingforward-looking radar sees slower vehicles aheadsystem automatically adjusts speed and maintains a selectable following distancedesired speed is resumed when the way ahead is clear some systems use digital maps to enhance operationsNow on the market for $1500-2000Trucks: US (2000)Cars: Japan (1997), Europe (1999), US (2000)Next generation: stop-n-go traffic operation

2000 XKR With ACC

Driver Assistance Systems: Collision WarningHeavy trucks are where the market action isOver 50,000 heavy trucks equipped with Eaton-Vorad radar-based systemcovers forward zone and right blind spotselling thousands per yearaccident reductions of 50% or greater not unusual for some fleets Lane departure warning entered heavy truck market in 1999 based on image processingfirst on Mercedes trucks (Europe), followed by Freightliner (Iteris system)now a factory option from Kenworth (SafeTRAC)suitable for automotive aftermarket

Assistwares Lane Departure Warning System

Driver Assistance Systems: Collision WarningTransit Bus Performance Specs in DevelopmentForward Collision Warning: San Mateo (Ca.) transit system with California PATHRear Impact CW: Ann Arbor Transit with VeridianLane Change / Merge CW: Pittsburgh Transit (100 buses) with Carnegie Mellonalso initial research in Pedestrian Detection / Avoidance

Driver Assistance Systems: Collision Warning for AutomotiveAdaptive Cruise Control systems are edging in this directionFord signed agreement with Iteris for Lane Departure Warning Systems for MY2003Japan SmartCruise systemsCW for forward obstacles/vehicles, road/lane departure, intersections, crossing paths, pedestrians, road conditionSystems also take control if driver does not heed warningMajor demo Nov 28 - Dec 1 near Tokyo

Driver Assistance Systems: Collision Warning for AutomotiveUSDOT-Industry Joint Pre-competitive Enabling Research agreement in the worksFord, GM, DaimlerChrysler, Nissan, Toyota & NavtechKey focus areas:Enhanced digital maps to augment collision warning systemsDevelop driver workload performance metricsAdditional work in test methodologies for CW

Driver Assistance Systems: Collision AvoidanceActivity in forward CA, vehicle dynamics control, lane departure prevention, ACC w/brake actuationNHTSA-GM: $35M cost-shared project: ACASusing radar, vision for forward sensingmostly collision warning, with modest brakingextensive algorithm development, vehicle integration, human factors (warnings), data collection, evaluationnaturalistic test with ten Buick LeSabres starts in 2002Major benefits in congestion relief majority of non-recurring congestion due to fender-benders

Driver Assistance Systems:Impairment MonitoringIs the Driver Fit to Drive???Technology exists to monitor:driving performance: lane keeping (SPI), steering wheel movementsphysiological factors:ocular measures: blink rate, blink velocity, % eye closure. you name ithead position monitoring

Driver Assistance Systems:Impairment MonitoringMajor government research is focused on truckingfatigue monitorsSystems are in product development cycle for cars and trucksOn the market:Trucks: Basic systems now, advanced systems under developmentCars: higher reliability needed; strong market perceived for older drivers

Driver Assistance Systems:Impairment MonitoringTechnology Approaches:Ocular measuresImage processing of drivers face with IR illuminationActive eye-trackingDoppler radar illumination of face/bodytracks eye movements, head movements, etc.Head movement monitoring using capacitor platesStereo image processing of eyes/face/headLane-keeping & steering input patterns

Headtrak:Proximity Array Sensing System

Driver Assistance Systems:Impairment MonitoringHow do you wake em up???Some say detect fatigue before drowsiness sets in, giving driver plenty of advance warningWhen drowsiness present, haptic feedback (seat vibration) seems most promising

Advanced Driver Assistance SystemsCo-Pilot functions will continue to emerge Stop-n-go ACC for congested traffic (~2003) Lane keeping on freeways (~2004)Merge assistance (~2006)The Killer App: Low Speed Automation!Automated throttle, brakes, steering in tedious stop-n-go trafficbeing developed in Europe, Japanavailability as early as 2005 overseas, 2007 in U.S.??

Cooperative Infrastructure Opens Up New PossibilitiesMagnetic lane marking enables snowplow operations in zero visibility (Ca, Az, Mn)Will car/truck products emerge to use magnet-marked roads?Magnetic lane marking tape and vehicle system recently commercialized by 3M (Lane Awareness System)Infrastructure Consortium looking at intersection collision avoidance techniquesCooperative vehicle-infrastructure standards process in early stagesArizona considering opening HOV lanes to Intelligent Vehicles, to incentivize public to adopt systems

Lane Awareness System: Sensor Bar on Snowplow

Insurance/Liability Implications:Enhanced DVIDriver-vehicle interface evolvingvoice-activated control, hands-free cellular phone, e-mail read to driverOK, hands are on the wheel -- but where is the drivers attention?Eye-tracking technology tracks attention placementDriver warnings can be tuned to attention placementOK, attention is on the road -- but where is drivers brain? Unsolved mystery.

Insurance/Consumer Implications:New Product OpportunitiesNew insurance products assess premiums in real-time, based on vehicle location & timeFuture products: what can be monitored that provides an indication of driver behavior?Frequency of hard accelerations, hard braking, excess speed, excess lateral acceleration, ..Driving while fatiguedDriving with insufficient attention on the roadSafe drivers can choose to be monitored in order to save a few bucksWhat should be monitored? Industry, regulators, and consumers will decide

Automated Driving: its coming!Hands-off, feet-off driving: customers want itDemonstrated in 1997 by National Automated Highway System ConsortiumBasic system capability existsmachine intelligence & machine perception now being refined by researchers (California PATH, Ohio State U., France, Germany, Japan, Korea)must transform into an affordable, trustworthy productBishop prediction: available in 2010Revolutionary changes in societytravel

Automated Driving:Passenger Cars (1)California PATH: work continuing since Demo 97 to refine algorithms, hardware for both cars and heavy trucksMechanical Engineering Lab (Japan): cooperative driving using 5.8 GHz DSRC intervehicle communication, DGPS, machine vision, radar, laserPublic demo announced for Nov. 22-27 near TokyoLIVIC: French La Route Automatisee programresearch labs INRIA, INRETS, LCPC and OEM partnersfocusing on sensor fusion in CARSENSEscenarios and deployment paths defined for rural, intercity, and commuter scenarios

Automated Driving:Passenger Cars (2)Korea University: KAV-5 relies on four cameras to follow road, vehicles University of Parma (Italy): ARGO vision-based autonomous vehiclesuccessfully completed 2000 km tour of Italian roadsArizona: conducted a planning study for automated lanes in median of Interstate 10 (Phoenix-Tucson)

Automated Driving: Heavy TrucksCHAUFFEUR program in Europe demonstrated electronic tow-bar in 1999Lead truck closely followed by fully automated second truckUsing vehicle-vehicle communication, image processing, active infrared, radarCHAUFFEUR II implementing multiple trucks in platoons and improved image processingLed by DaimlerChrysler with Renault VI and Iveco as OEM partnersCaltrans is sponsoring a study of adding automated truck lanes to Interstate 10, coast-to-coast

Automated Driving:Transit BusesBus Rapid Transit concept seeks to combine rail-like capacity with flexibility of busesExclusive lane operation in urban areas sometimes requires narrow lanes and lateral guidance Guided bus systems being implemented in France, Netherlands, UK, USAToyota: Intelligent Multimodal Transit Systemfully automated, using platooning techniques Technologies include magnetic guidance, image processing

Automated Driving:Demo 2002California DOT taking a lead role to stimulate the implementation of automated vehicles -- key to congestion reliefsees trucks / buses as precursor to carsCaltrans sponsoring Demo 2002Trucks in electronic towbar convoysBus trains California PATH leading development

Automated Vehicles:Military / IndustrialUSDOD sponsoring $50 Demo III projectautonomous unmanned scout vehiclesoff-road operation at 20 mphon-road operation at 40 mphusing extensive sensor suite: MMW radar, foliage penetrating radar, laser scanner, FLIR, monochrome and color vision, stereo visionFour vehicle undergoing rugged testing with the troops in October

Automated Vehicles:Military / IndustrialPort automation: automated freight container movement (Rotterdam)Autonomous mining vehiclesAustralian Centre for Field Roboticsstrip miningunderground mining

SummaryTheres a lot going on! . A diverse array of activity for all vehicle typesLook for increasingly intelligent vehicles to move most rapidly into commercial vehicle markets -- where the intelligence enhances the bottom lineLook for consumers to become increasingly comfortable with driver aids and demand more relief from the tedium of driving .and look for the technology to deliver.

Resources / EventsITS World Congress Intelligent Vehicle ExhibitionNovember 6-9, Turin, ItalyJapans Demo 2000 (www.ahsra.or.jp)November 27 - December 1, Tsukuba City, JapanITS America (www.itsa.org)www.IVsource.net -- Continued updates and reporting

HandoutsIntelligent Vehicles for ArizonaMack Trucks IVI Op Test Fact SheetMack ElectronicsSafeTRAC Lane Departure Warning3M Lane Awareness System samples of magnetic tapePaper: Survey of IV Applications WorldwideJapan Demo 2000

Thank you.