LAHMP TM : Open Standards For Sensors And Data Acquisition For Health Monitoring Chris Coughlin, Russell Austin ASNT 15 th Annual Research Symposium Orlando.

LAHMPLAHMPTMTM: Open Standards For : Open Standards For Sensors And Data Acquisition For Sensors And Data Acquisition For

Health MonitoringHealth Monitoring

Chris Coughlin, Russell AustinChris Coughlin, Russell Austin

ASNT 15ASNT 15thth Annual Research Symposium Annual Research Symposium

Orlando Florida 14-16 March 2006Orlando Florida 14-16 March 2006

OutlineOutline

• IntroductionIntroduction• Condition-Based Maintenance (CBM)Condition-Based Maintenance (CBM)

– RequirementsRequirements– StandardsStandards

• Example: LAHMPExample: LAHMP• Summary And ConclusionsSummary And Conclusions

IntroductionIntroduction

• LAHMP: Large Area Health Monitoring ProcessorLAHMP: Large Area Health Monitoring Processor– Processor => Platform ?Processor => Platform ?– Self-contained embedded data acquisition and analysis platform Self-contained embedded data acquisition and analysis platform

built on (open) standards and open sourcebuilt on (open) standards and open source– More laterMore later

• Purpose of presentationPurpose of presentation– Convince you as an OEM to use standardsConvince you as an OEM to use standards

• Don’t have to convince buyers...Don’t have to convince buyers...

– Discuss several relevant standards to NDE and CBMDiscuss several relevant standards to NDE and CBM– Provide an example (LAHMP)Provide an example (LAHMP)

• Health MonitoringHealth Monitoring– distributed in-situ sensor networks that assess current condition ofdistributed in-situ sensor networks that assess current condition of

• structurestructure

• engineengine

• bearingbearing

• pressure vesselpressure vessel

• pipes, tubing, etc.pipes, tubing, etc.

• Prognostics, On-Condition Maintenance, etc.Prognostics, On-Condition Maintenance, etc.– given current condition, assess future likely condition, plan for given current condition, assess future likely condition, plan for

maintenance based on assessmentmaintenance based on assessment– maximize maintenance ROI-repair when you have tomaximize maintenance ROI-repair when you have to

CBMCBM

CBM PrognosticsCBM Prognostics

• 1. Predicting The Future1. Predicting The Future– simple extrapolation?simple extrapolation?– complex pattern recognition?complex pattern recognition?

• neural networks, etc.neural networks, etc.

• ““Past performance may not be an indication of future returns…”Past performance may not be an indication of future returns…”

• 2. System Assessment2. System Assessment– statistical modeling (neural nets etc.): run many tests and measurestatistical modeling (neural nets etc.): run many tests and measure

• did you test all possible modes of failure?did you test all possible modes of failure?

• did you test for aged sensor performance?did you test for aged sensor performance?

• did your test include realistic operating environment?did your test include realistic operating environment?

– physics-based modeling: established relationships between physics-based modeling: established relationships between sensor measurements and physical phenomena, i.e. strain gaugesensor measurements and physical phenomena, i.e. strain gauge

CBM RequirementsCBM Requirements

• Sensors (surprise!)Sensors (surprise!)– Pressure, Temperature, HumidityPressure, Temperature, Humidity– CorrosionCorrosion– Crack Detection / PropagationCrack Detection / Propagation– StrainStrain– Vibration, etc.Vibration, etc.

• Sensors (usually) requireSensors (usually) require– PowerPower– CommunicationsCommunications– ValidationValidation

CBM Requirements, cont...CBM Requirements, cont...

• PowerPower– internal powerinternal power– draw from vehicledraw from vehicle– inductive power, power harvesting (immature / Holy Grail), etc.inductive power, power harvesting (immature / Holy Grail), etc.

• CommunicationsCommunications– communicate with usercommunicate with user– (optional) communicate with other systems(optional) communicate with other systems

• ValidationValidation– System monitoringSystem monitoring– (optional) redundancies(optional) redundancies

CBM Requirements, cont...CBM Requirements, cont...

• Bringing it all Bringing it all together: sample together: sample CBM installationCBM installation

• But why use But why use standardizedstandardized– Sensors?Sensors?– Communications?Communications?– Anything?Anything?

Why Use Standards?Why Use Standards?

• Development CostsDevelopment Costs– Why (pay to) reinvent the wheel?Why (pay to) reinvent the wheel?

• Reliability IssuesReliability Issues– ““Many eyes make all bugs shallow”Many eyes make all bugs shallow”

• Standards have been tested much more than any in-house solution Standards have been tested much more than any in-house solution ever couldever could

• Flexibility Of DesignFlexibility Of Design– Avoid “vendor lock”Avoid “vendor lock”

• What do you do when your vendor goes out of business?What do you do when your vendor goes out of business?

– Rapidly adjust to new market conditions / “flavor of the month”Rapidly adjust to new market conditions / “flavor of the month”

• Your customers will thank you!Your customers will thank you!

When To Not Use Standards?When To Not Use Standards?

• Realism: not everything can or should be wide openRealism: not everything can or should be wide open– Protect IPProtect IP

• algorithms, patents, etc.algorithms, patents, etc.

– SecuritySecurity• protection against attacks, encrypted communications, etc.protection against attacks, encrypted communications, etc.

– Licensing IssuesLicensing Issues• e.g. you don’t have the rights to your componentse.g. you don’t have the rights to your components

– Expense (always a favourite)Expense (always a favourite)– No standardNo standard

• Nothing fits, nothing exists, etc.Nothing fits, nothing exists, etc.

• Start your own?Start your own?

Relevant StandardsRelevant Standards

• Most Important: Communications And Data ExchangeMost Important: Communications And Data Exchange– Communications between user and system, system and sensor, Communications between user and system, system and sensor,

system and other systemssystem and other systems– Data exchange-how do I get my data out of there?Data exchange-how do I get my data out of there?

• Useful standards to consider, now and in the futureUseful standards to consider, now and in the future– IEEE 1451IEEE 1451– ZigbeeZigbee– Usual commercial suspects: CAN, WiFi, WiMax, Bluetooth, etc.Usual commercial suspects: CAN, WiFi, WiMax, Bluetooth, etc.– Usual avionics suspects: ARINC 429, MIL-STD-1553, etc.Usual avionics suspects: ARINC 429, MIL-STD-1553, etc.– XML, XML-RPC, SOAP, etc.XML, XML-RPC, SOAP, etc.

IEEE 1451IEEE 1451

• Courtesy IEEE:Courtesy IEEE:– ““describes a set of open, common, network-independent describes a set of open, common, network-independent

communication interfaces for connecting transducers (sensors or communication interfaces for connecting transducers (sensors or actuators) to microprocessors, instrumentation systems, and actuators) to microprocessors, instrumentation systems, and control/field networks”control/field networks”

• An “open” ($ from IEEE) standard for smart sensor An “open” ($ from IEEE) standard for smart sensor networkingnetworking– One fieldbus to rule them all: Wikipedia currently lists 10 One fieldbus to rule them all: Wikipedia currently lists 10

commercial fieldbus systems (CAN, DeviceNet, …)commercial fieldbus systems (CAN, DeviceNet, …)• Doesn’t include the vast number of “home grown” fieldbus protocolsDoesn’t include the vast number of “home grown” fieldbus protocols

• Limited industry support for now, but could be bigLimited industry support for now, but could be big

ZigbeeZigbee

– addresses the unique addresses the unique needs of remote monitoring needs of remote monitoring & control, and sensory & control, and sensory network applicationsnetwork applications

– enables broad-based enables broad-based deployment of wireless deployment of wireless networks with low cost, low networks with low cost, low power solutionspower solutions

– provides the ability to run provides the ability to run for years on inexpensive for years on inexpensive primary batteries for a primary batteries for a typical monitoring typical monitoring applicationapplicationSource: Zigbee Alliance, www.zigbee.org

Zigbee In A NutshellZigbee In A Nutshell

XML And SOAPXML And SOAP

• XML: Extensible Markup LanguageXML: Extensible Markup Language– Similar structure to HTMLSimilar structure to HTML– Becoming Becoming thethe data exchange protocol data exchange protocol

• Buzzword CompliantBuzzword Compliant

– XML-RPC: Remote Procedure Calls with XMLXML-RPC: Remote Procedure Calls with XML• ““It's remote procedure calling using HTTP as the transport and XML It's remote procedure calling using HTTP as the transport and XML

as the encoding. XML-RPC is designed to be as simple as possible, as the encoding. XML-RPC is designed to be as simple as possible, while allowing complex data structures to be transmitted, processed while allowing complex data structures to be transmitted, processed and returned.” (xml-rpc.com)and returned.” (xml-rpc.com)

• SOAP: formerly Simple Object Access ProtocolSOAP: formerly Simple Object Access Protocol– Not so simple any moreNot so simple any more– Big Brother to XML-RPC, also uses XML for encodingBig Brother to XML-RPC, also uses XML for encoding

Example: LAHMPExample: LAHMP

• COTS-based generic COTS-based generic data acquisition and data acquisition and analysis systemanalysis system

• Modular systemModular system– add / subtract hardware as add / subtract hardware as

requiredrequired• OS is customized Linux: OS is customized Linux:

full source codefull source code

– add / subtract software as add / subtract software as requiredrequired

• Current modules: AE, Current modules: AE, UltrasonicsUltrasonics

LAHMP CharacteristicsLAHMP Characteristics

• Base model specs:Base model specs:– 6"x6"x2", 2 lbs. with ruggedized aluminum enclosure6"x6"x2", 2 lbs. with ruggedized aluminum enclosure– Power draw is less than 10 W (typical) / 15 W (maximum)Power draw is less than 10 W (typical) / 15 W (maximum)

• 10 Million samples / second / channel acquisition10 Million samples / second / channel acquisition– Typical sensor configuration: 2-4 sensors with 12"-36" cable lengthTypical sensor configuration: 2-4 sensors with 12"-36" cable length

• Full data analysisFull data analysis– condition and recommended course of action / RULcondition and recommended course of action / RUL

• 0% to 95% relative humidity (non-condensing) operating 0% to 95% relative humidity (non-condensing) operating rangerange

• 0-70 C base temp operating range (-40 to +85 C optional)0-70 C base temp operating range (-40 to +85 C optional)

Standards In LAHMPStandards In LAHMP

• ““Out Of The Box” Out Of The Box” CommunicationsCommunications– With User: standard WiFi, Ethernet, With User: standard WiFi, Ethernet,

USB, etc.USB, etc.• e.g., can be controlled by any web-e.g., can be controlled by any web-

enabled deviceenabled device

– With Sensors: generic analog With Sensors: generic analog voltage, digital outsvoltage, digital outs

• Optional CommunicationsOptional Communications– With User: Zigbee, Bluetooth, etc.With User: Zigbee, Bluetooth, etc.– With Sensors: Zigbee, IEEE 1451, With Sensors: Zigbee, IEEE 1451,

CAN, etc.CAN, etc.

Standards In LAHMP, cont...Standards In LAHMP, cont...

• Operating System: Customized LinuxOperating System: Customized Linux– Shamelessly code-named “Coughlinux”Shamelessly code-named “Coughlinux”– Full OS source code to customersFull OS source code to customers

• End-user can add/subtract hardware and End-user can add/subtract hardware and functionality as desiredfunctionality as desired

– Add “hard” real-time capability, GPS, even full-blown Add “hard” real-time capability, GPS, even full-blown MATLAB for signal processingMATLAB for signal processing

Image courtesy Larry Ewing,[email protected]

• LAHMP acquisition / analysis softwareLAHMP acquisition / analysis software– Runs on LAHMP and conventional PC; proprietary (closed-source) Runs on LAHMP and conventional PC; proprietary (closed-source)

• not everything can be wide open...not everything can be wide open...

– Uses open standards for data exchangeUses open standards for data exchange• ASCII text, HTML / XML, published binary formats, etc.ASCII text, HTML / XML, published binary formats, etc.

• What did TRI gain from using open standards in LAHMP?What did TRI gain from using open standards in LAHMP?– Small company, even smaller development group, originally a Small company, even smaller development group, originally a

small projectsmall project• Demonstrated working prototype in under six monthsDemonstrated working prototype in under six months

– FlexibleFlexible• started as DOS-based, moved to Linux with same hardware, now started as DOS-based, moved to Linux with same hardware, now

considering Windows implementationconsidering Windows implementation

• We can rapidly adapt to new CBM applications and opportunitiesWe can rapidly adapt to new CBM applications and opportunities

– Easy IntegrationEasy Integration• reporting / control can be done by anything from anywherereporting / control can be done by anything from anywhere

– Sponsor loves Blackberry-we deliver a system that works with his existing Sponsor loves Blackberry-we deliver a system that works with his existing tools...tools...

» ...but we aren’t locked in!...but we aren’t locked in!

Realized BenefitsRealized Benefits

Sample LAHMP ApplicationSample LAHMP Application

• Acoustic Emission Acoustic Emission Health MonitoringHealth Monitoring– COTS AE transducers COTS AE transducers

acquire raw dataacquire raw data– Stored and analyzed in Stored and analyzed in

LAHMPLAHMP– LAHMP assesses health LAHMP assesses health

of vehicle, recommends of vehicle, recommends a course of action (if a course of action (if req’d)req’d)

– Reports to larger Reports to larger HUMS/HMSHUMS/HMS

Summary And ConclusionsSummary And Conclusions

• NDE and CBM systems can greatly benefit from using NDE and CBM systems can greatly benefit from using standards where possible / appropriatestandards where possible / appropriate– lower development / support costs, greater flexibilitylower development / support costs, greater flexibility– Customers will start to demand itCustomers will start to demand it

• ““Why can’t I use my Blackberry?”Why can’t I use my Blackberry?”

• ““Why should I buy Yet Another Black Box?”Why should I buy Yet Another Black Box?”

• Customers and OEMs both benefitCustomers and OEMs both benefit– Unless you’re a monopoly…Unless you’re a monopoly…

• TRI/Austin has developed, continues to develop a family of TRI/Austin has developed, continues to develop a family of systems to implement standards-based V/S/PHM for a systems to implement standards-based V/S/PHM for a variety of applicationsvariety of applications