Big data in freight transport
!
Per Olof Arnäs Chalmers
@Dr_PO [email protected]
!Slides on slideshare.net/poar
Film by Foursquare. Google: checkins foursquare
We are in the middle of a gigantic exponential development curve
beginning
Gartners Hype Cycle for Emerging Technologies
Source: Gartner August 2014
Gartners Hype Cycle for Emerging Technologies
Could affect freight transport
”Fast Up-and-Coming Movers Toward the Peak Are Fueled by Digital Business and Payments”
”…the market has settled into a reasonable set of approaches, and the new technologies and practices are additive to existing solutions” (regarding the decline of Big data on the curve)
Gartner, August 2014
Gartners Hype Cycle for Emerging Technologies
So…
What is Big data?
2011 2013 2015
”Big data is an all-encompassing term for any collection of data sets so large and complex that it becomes difficult to process using on-hand data management tools or traditional data processing applications.”
- Wikipedia
2015
Not statistics
Exhausted by Adrian Sampson on Flickr (CC-BY)
just
Not Business
Intelligence
Basingstoke Office Staff Desk "No computer" by John Sheldon on Flickr (CC-BY,NC,SA)
just
http://dashburst.com/infographic/big-data-volume-variety-velocity/
Google flights
https://www.google.se/flights/
Jawbone measures sleep interruption during earthquake
https://jawbone.com/blog/napa-earthquake-effect-on-sleep/
Strategic Tactical Operational Predictive
Time horizons Freight industry
Most (preferably all) decisions in the
transportation industry are made here. At the latest.
Uninformed, ad-hoc, and
probably non optimal,
decisions
Science fiction
Strategic Tactical Operational Predictive
But with technology, we are approaching
this boundary
…and we are starting to move past it!
Real-time!
Time horizons Freight industry
smile! by Judy van der Velden (CC-BY,NC,SA)
Speculative shipping
http://www.scdigest.com/ontarget/14-01-21-1.php?cid=7767
http://www.scdigest.com/ontarget/14-01-21-1.php?cid=7767
Speculative shipping Package item(s) as a package for
eventual shipment to a delivery address
Associate unique ID with package
Select destination geographic area for package
Ship package to selected distribution geographic area without completely
specifying delivery address
Orders satisfied by item(s)
received?
Package redirected?
Determine package location
Convey delivery address, package ID to delivery location
Assign delivery address to package
Deliver package to delivery address
Convey indication of new destination geographic area and package ID to
current location
Yes
Yes
No
No
smile! by Judy van der Velden (CC-BY,NC,SA)
Business processes
Infra- structure
Paper based Phone
Papers
Road signsAnalogue
tools
RDS
Monitor fuel
cosnumption
Digitization version 0 0.5 1.0 1.5 2.0
E-m
ail
Fax
TMS
-
systems
Excel
Route planning
GPS for n
avigatio
n
Electro
nically
genera
ted
freig
ht docum
ents
Barcodes
RFI
D-t
ags
Simple order handling
Advanced order handling
Open interface
Web
based UI
Platform based
systems
Hardw
are-
oriented
Data collection
systems
(prop
rietary)
Com
munication w
ith
vehicles
E-invoice
Web based
booking
Route optimisation
Th
e so
cia
l web
Open connectivity
Integrated
prognosis
Data collection
systems (open)
Tolling
systems
Webservices with
traffic data
Dyn
amic
ro
utin
g sy
stem
s
Pe
rform
an
ce
Ba
sed
ac
ce
ss
Pe
rfo
rma
nc
e
Ba
sed
ac
ce
ss
Mas
hups
Mul
tiple
dat
a so
urce
s
Pro
be
dat
a
Individual
routin
g
inform
ation
Platooning
PlatooningExceptions handling
Sm
art g
ood
s
Manual
Computers
Software
Functions
Dis
trib
uted
deci
sion
m
akin
g
Goods as bi-
directio
nal
hyperlink
Paper based
CC-BY Per Olof Arnäs, Chalmers
Goods VehicleBarcodes
RFID Sensors
ERP systems TMS systems
E-invoices Cloudbased
services
Order handling Driver support Vehicle economics
RDS-TMC Road taxes Active traffic support
Predictive
maintenance
2014-08-26
En la cima! by Alejandro Juárez on Flickr (CC-BY)
3 mountaintops to climb…
En la cima! by Alejandro Juárez on Flickr (CC-BY)
3 data types
Mountaintop #1
Collection of data in real-time
Fixed Historical Snapshot
En la cima! by Alejandro Juárez on Flickr (CC-BY)
Mountaintop #1
Collection of data in real-time
5 data domainsVehicle CargoDriver Company
Infrastructure/facility
at leas
t…
Length Weight WidthHeight
Capacity + other PBS-criteria
EmissionsFuel consumption
Route
Position Speed
Direction
Weight Origin
Destination Accepted ETA
Temperature + other state variables
Temperature + other state variables
Education/training
Speed (ISA) Rest/break schedule
Traffic behaviour Belt usage
Alco lock history
Schedule status (time to next break etc.)
Contracts/ agreements Previous interactions Backoffice support
Fixed Historical Snapshot
Vehicle
Cargo
Driver
Company
Infrastructure/facility
Map + fixed data layers Traffic history
Current traffic Queue
Availability
DATA MATRIX
Mountaintop #2
Processing of data in real-time
En la cima! by Alejandro Juárez on Flickr (CC-BY)
Locals and Tourists #1 (GTWA #2): London by Eric Fischer on Flickr
Mountaintop #2
Processing of data in real-time
En la cima! by Alejandro Juárez on Flickr (CC-BY)
Mountaintop #3
Exploiting data in real-time
En la cima! by Alejandro Juárez on Flickr (CC-BY)
Connected. 362/365 by AndYaDontStop on Flickr (CC-BY)
Lisa for I/O Keynote by Max Braun on Flickr (CC-BY)
Fulham-Manchester United 24-02-2007 by vuhlser on Flickr (CC-
BY)
Mountaintop #3
Exploiting data in real-time
En la cima! by Alejandro Juárez on Flickr (CC-BY)
Boeing-KC-97 Stratotanker by x-ray delta one on Flickr (CC-BY)
CASES (MANY)
CASES (MANY MORE)
Human resources
Reduction in driver turnover, driver
assignment, using sentiment data
analysis
Real-time capacity availability
Inventory management
Examples of applications of Big data in freight (Waller and Fawcett, 2013)
Transportation management
Optimal routing, taking into account weather,
traffic congestion, and driver characteristics
Time of delivery, factoring in weather,
driver characteristics, time of day and date
Forecasting
Waller, M. A. and Fawcett, S. E. (2013), Data Science, Predictive Analytics, and Big Data: A Revolution That Will Transform Supply Chain Design and Management. JOURNAL OF BUSINESS LOGISTICS, 34: 77–84
7Big Data Best Practice Across Industries
Usage of data in order to:Increase Level of TransparencyOptimize ResourceConsumption Improve Process Qualityand Performance
Increase customersloyalty and retentionPerforming precisecustomer segmentationand targetingOptimize customerinteraction and service
Expanding revenuestreams from existingproductsCreating new revenuestreams from entirelynew (data) products
Exploit data for: Capitalize on data by:
New Business Models
Customer Experience
OperationalEfficiency
Use data to: • Increase level of
transparency• Optimize resource
consumption • Improve process quality
and performance
Exploit data to: • Increase customer
loyalty and retention• Perform precise customer
segmentation and targeting • Optimize customer interaction
and service
Capitalize on data by: • Expanding revenue streams
from existing products • Creating new revenue
streams from entirely new (data) products
New Business ModelsCustomer ExperienceOperational Efficiency
Figure 4: Value dimensions for Big Data use cases; Source: DPDHL / Detecon
2.1 Operational Efficiency
For metropolitan police departments, the task of tracking down criminals to preserve public safety can sometimes be tedious. With many siloed information repositories, casework often involves making manual connection of many data points. This takes times and dramatically slows case resolution. Moreover, road policing resources are deployed reactively, making it very difficult to catch criminals in the act. In most cases, it is not possible to resolve these challenges by increasing police staffing, as government budgets are limited.
One authority that is leveraging its various data sources is the New York Police Department (NYPD). By capturing and connecting pieces of crime-related information, it hopes to stay one step ahead of the perpetrators of crime.6 Long before the term Big Data was coined, the NYPD made an effort to break up the compartmentalization of its data ingests (e.g., data from 911 calls, investigation reports, and more). With a single view of all the informa-
tion related to one particular crime, officers achieve a more coherent, real-time picture of their cases. This shift has significantly sped up retrospective analysis and allows the NYPD to take action earlier in tracking down individual criminals.
The steadily decreasing rates of violent crime in New York7 have been attributed not only to this more effective streamlining of the many data items required to perform casework but also to a fundamental change in policing practice.8 By introducing statistical analysis and georaphical mapping of crime spots, the NYPD has been able to create a “bigger picture” to guide resource deployment and patrol practice.
Now the department can recognize crime patterns using computational analysis, and this delivers insights enabling each commanding officer to proactively identify hot spots of criminal activity.
6 “NYPD changes the crime control equation by the way it uses information”, IBM; cf. https://www-01.ibm.com/software/success/cssdb.nsf/CS/JSTS-6PFJAZ7 “Index Crimes By Region”, New York State Division of Criminal Justice Services, May 2013, cf. http://www.criminaljustice.ny.gov/crimnet/ojsa/stats.htm8 “Compstat and Organizational Change in the Lowell Police Department”, Willis et. al., Police Foundation, 2004; cf. http://www.policefoundation.org/
content/compstat-and-organizational-change-lowell-police-department
2.1.1 Utilizing data to predict crime hotspots
DHL 2013: ”Big Data in Logistics”
Manage complex systems
Image from: http://www.as-coa.org/watchlisten/ascoa-visits-rios-operations-center
Measure real-time
system behaviour
Emil Johansson - EJOH.SE
http://blog.digital.telefonica.com/?press-release=telefonica-dynamic-insights-launches-smart-steps-in-the-uk
Vizualisation
Predict future events
Avoid unpleasant surprises
Domain knowledge critical!
See for instance: Waller, M. A. and Fawcett, S. E. (2013), Data Science, Predictive Analytics, and Big Data: A Revolution
That Will Transform Supply Chain Design and Management. JOURNAL OF BUSINESS LOGISTICS, 34: 77–84
Data scientists - the new superstars
"Data Science Venn Diagram" by Drew Conway - Own work. Licensed under Creative Commons Attribution-Share Alike 3.0 via Wikimedia Commons - http://commons.wikimedia.org/wiki/File:Data_Science_Venn_Diagram.png#mediaviewer/File:Data_Science_Venn_Diagram.png
Challenges
The Challenger by Martín Vinacur on Flickr (CC-BY)
Cross-disciplinary
Cross-industries
Cross-borders
Big data in freight transport
!
Per Olof Arnäs Chalmers
@Dr_PO [email protected]
!Slides on slideshare.net/poar
Film by Foursquare. Google: checkins foursquare