Program Name or Ancillary Text eere.energy.gov
Ruth Taylor Pacific Northwest National Laboratory
LIGHTFAIR May 9-12, 2012
COMMERCIALLY AVAILABLE LED PRODUCT EVALUATION AND REPORTING PROGRAM
Recent Findings from CALiPER Testing
www.ssl.energy.gov 2 | Solid-State Lighting Program
DOE SSL Support Programs
www.ssl.energy.gov 3 | Solid-State Lighting Program
CALiPER at a Glance
Why testing products is valuable: Capture market trends and gauge performance levels Identify important areas for improvement Manufacturer accountability Inspire consumer confidence
Scope of products: SSL General illumination White light Market available
www.ssl.energy.gov 4 | Solid-State Lighting Program
CALiPER Process
Product Selection & Purchasing
Independent LM-79-08 Testing
Data Analysis
Report Publication
www.ssl.energy.gov 5 | Solid-State Lighting Program
Step 1: Selection & Purchasing
I. Industry observations Conventions, trade shows, and conferences Trade publications, popular media Manufacturer marketing materials
II. LED Lighting Facts quality assurance concerns Do reported values reflect commercially available products?
III. CALiPER guidance committee
Manufacturers can’t request tests or submit products!
www.ssl.energy.gov 6 | Solid-State Lighting Program
Step 1: Selection & Purchasing
Challenges in the early stages: Setting criteria—capture the market? ‘Vapor fixtures’—we just can’t get them Very long lead times We must be very careful that we receive what we ordered Products sometimes arrive damaged or broken
www.ssl.energy.gov 7 | Solid-State Lighting Program
Step 2: SSL Luminaire Testing
Independent testing laboratories
Uses absolute photometry rather than relative photometry (IES LM-79-08) Must measure luminaire as a
complete system
Benchmark products for each application are also tested to LM-79
Integrating sphere and goniophotometer testing
Photo credit: Luminaire Testing Laboratory
www.ssl.energy.gov 8 | Solid-State Lighting Program
Step 3: Data Analysis
Performance compared to conventional technologies
Performance relative to manufacturer data
Evaluation of equivalency claims
Comparison to LED Lighting Facts
Comparison to ENERGY STAR® (or other) criteria
www.ssl.energy.gov 9 | Solid-State Lighting Program
Step 3: Data Analysis
Key questions to answer: Does the product perform as claimed?
Marketing literature (equivalency and performance claims) Specification sheets (at the time of the order) Product packaging
Does the product perform as expected? What are you replacing? What are you trying to accomplish? How does the SSL product compare to conventional alternatives?
www.ssl.energy.gov 10 | Solid-State Lighting Program
Step 4: Report Publication
2006–2011 SUMMARY REPORTS
3 “Rounds” per year Range of products
Summary Reports
Detailed Reports
Special Reports
New for 2012! APPLICATION
REPORTS Continuous data More focused LED Lighting Facts QA
www.ssl.energy.gov 11 | Solid-State Lighting Program
2006 Pilot phase 4 products (hard to
purchase)
2007 Rounds 1-3 Small replacement
lamps, desk lamps, undercabinet, small downlights
2008 Rounds 4-6 Downlight and T8 in
situ testing, replacement lamps
2009 Rounds 7-9 Streetlights, bollards,
downlights, 2x2 panels, 2x4 troffers, replacement lamps
2010 Rounds 10, 11 Parking garage, wallpack,
cove lights, replacement lamps, roadway, high-bay
2011 Rounds 12, 13 Downlights, track lights, A-
lamps, T8 replacements, cove lights, high-bays, wall packs, 2x2 troffers
Summary Reports
Comparative Analysis
www.ssl.energy.gov 12 | Solid-State Lighting Program
This Year
Flood lights AR111,BR30,PAR38
Linear pendants Wall washers
Upcoming Testing
Released Downlight Retrofits (New Format!) Retail Replacement Lamps 2 (Special)
Next Year
High-output A-lamps Troffers (2x4s, 2x2s) T-8 Replacements Track Bollards
www.ssl.energy.gov 13 | Solid-State Lighting Program
Detailed Reports
Login to CALiPER Page
www.ssl.energy.gov 14 | Solid-State Lighting Program
Detailed Reports
Login to CALiPER Page
www.ssl.energy.gov 15 | Solid-State Lighting Program
Detailed Reports
See Full Test Results!
www.ssl.energy.gov 16 | Solid-State Lighting Program
Past and Future Efforts
Special Reports
Benchmark Reports PAR Lamp Benchmark Report* A Lamp Benchmark Report MR16 Benchmark Report Troffer Benchmark Report
Exploratory Studies Dimming Product and Testing Variability Long-term Testing Thermal Imaging Flicker Future: Flicker, Dimming, Power
Quality Tradeoffs Future: Office & Classroom Lighting
www.ssl.energy.gov 17 | Solid-State Lighting Program
Performance to Date
0
20
40
60
80
100
120
2006
Mea
n Ef
ficac
y (lm
/W)
2007 2008 2009 2010 2011
CALiPER Test Results
[All Product Types]
www.ssl.energy.gov 18 | Solid-State Lighting Program
High Level Observations
Overall improvements in light output, efficacy, light distribution, power factor, color quality
Manufacturer claims are improving (LED Lighting Facts label helps) but equivalency claims are still a problem
Suitability often depends on application Comparable products are now found in many lighting applications Poor performing products are also found
Careful comparisons based on accurate performance data is an absolute necessity
Be cognizant of “secondary” quality issues: glare, flicker, color tolerances, physical formats, reliability…
www.ssl.energy.gov 19 | Solid-State Lighting Program
Recent Findings
Retail Replacement Lamp Study - #2 Retrofit Downlights Floods
www.ssl.energy.gov 20 | Solid-State Lighting Program
Retail Replacement Lamps (Part 2!)
Special Reports
38 Total Products. 9 Different Retailers. 18 Different Manufacturers.
A19 G25 MR16 PAR20 PAR30
www.ssl.energy.gov 21 | Solid-State Lighting Program
Retail Replacement Lamps (Part 2!)
0
100
200
300
400
500
600
700
800
900
1000
$0 $10 $20 $30 $40 $50 $60 $70 $80
Out
put (
lm)
Cost per Lamp
Retail Replacement Lamps 2 Retail Replacement Lamps 1 Incandescent Benchmarks Halogen Benchmarks CFL Benchmarks
1. Includes only products of the same types tested in RRL2.
RRL1: $139/klm1
RRL2: $63/klm (mean)
Special Reports
www.ssl.energy.gov 22 | Solid-State Lighting Program
Bang for the Buck? Luminous Efficacy
22
0
10
20
30
40
50
60
70
80
90
100
$0 $10 $20 $30 $40 $50 $60 $70 $80
Lum
inou
s Ef
ficac
y (lm
/W)
Cost per Lamp
Retail Replacement Lamps 2 Retail Replacement Lamps 1 Incandescent Benchmarks Halogen Benchmarks CFL Benchmarks
RRL1: $0.69/lm/W1
RRL2: $0.49/lm/W (mean)
1. Includes only products of the same types tested in RRL2.
www.ssl.energy.gov 23 | Solid-State Lighting Program
Retailers: Is Listed Performance Accurate?
23
Ret
aile
r
Lumen Output Expectations Efficacy Expectations
A
B
C
D
E
F
I
J
K
Note: Products listed for a retailer include any sold at the store that were tested as part of RRL2, regardless of purchase location.
Ret
aile
rs a
lso
test
ed in
RR
L1
Meets Below Above Criteria: ±10%
www.ssl.energy.gov 24 | Solid-State Lighting Program
Manufacturers: Is Listed Performance Accurate?
24
Lumen Output Expectations Efficacy Expectations
Man
ufac
ture
r
1 2 3 4 5 6 8 9 10 11 12 13 14 15 16 17 18 19
Man
ufac
ture
rs
also
test
ed in
R
RL1
Meets Below Above Criteria: ±10%
www.ssl.energy.gov 25 | Solid-State Lighting Program
Product Type: Is Listed Performance Accurate?
25
Lumen Output Expectations Efficacy Expectations
Pro
duct
Typ
e
A19
G25
MR/PAR16
R/PAR20
R/PAR30
Meets Below Above Criteria: ±10%
www.ssl.energy.gov 26 | Solid-State Lighting Program
Comparison to First Study
Lumen output, efficacy, and color rendering all improved when evaluated on a cost per lamp basis. Increased prevalence of product labels
Significant increase in number of lamps with ENERGY STAR qualification (29% vs. 6%).
Significant increase in number of lamps listed by LED Lighting Facts (61% vs. 15%).
Better at meeting manufacturer data In RRL1, 56% of products met output claims, whereas in RRL2, 68%
met output claims (92% met or were above). In RRL1, 79% of products met color quality claims, whereas in RRL2
92% met color claims (both CRI and CCT). More for the money
55% reduction in cost per kilolumen ($63 versus $139) in just 15 months
38% reduction in cost/lumen/watt ($0.49 versus $0.79) in just 15 months
26
www.ssl.energy.gov 27 | Solid-State Lighting Program
Summary Report 14 Retrofit Downlights
11-76 11-75 11-74 11-73 11-64 11-63
11-103 11-98 11-97 11-96 11-82
www.ssl.energy.gov 28 | Solid-State Lighting Program
Summary Report 14 Retrofit Downlights
www.ssl.energy.gov 29 | Solid-State Lighting Program
Summary Report 14 Retrofit Downlights
www.ssl.energy.gov 30 | Solid-State Lighting Program
Summary Report 15 - Floods
11-99 11-78 11-77 11-71 11-70
12-06 12-01 11-105 11-101 11-100
www.ssl.energy.gov 31 | Solid-State Lighting Program
Summary Report 15 - Floods
www.ssl.energy.gov 32 | Solid-State Lighting Program
Summary Report 15 - Floods
www.ssl.energy.gov 33 | Solid-State Lighting Program
Summary Report 15 - Floods
www.ssl.energy.gov 34 | Solid-State Lighting Program
Ruth Taylor Pacific Northwest National Laboratory
LIGHTFAIR May 9-12, 2012
Questions?
Ruth Taylor [email protected]