Timesys Test Automation Solution (TAS) with Continuous Testing Built on open-source, and deployed behind your firewall Designed to complement and extend your existing test infrastructure, TAS is composed of six major components that include: • Remote Access Embedded Board Farm (EBF): Features APIs to integrate test automation frameworks and develop test cases for embedded devices • Test Framework: Pre-integrated LAVA test automation framework, extensible and bundled with open-source test case templates, test job wizard for scheduling tests, and email notification of test job status • CI System: Pre-Integrated with Jenkins, a Continuous Integration (CI) system, enables continual testing to reveal functional and performance regressions at Linux kernel, OS, and application levels • Development Environment and Build Systems Integration: Pre-integrated with Yocto BSPs and Timesys Factory BSPs • Test Case Management: Built-in with creation of test cases, test suites, and test plans, and importing of existing test case capabilities • Report Management: Report generation in multiple formats, report comparison between test job runs, and import of test reports from other test frameworks Develop new test cases, test suites and integrate existing test cases using Remote Access EBF APIs. Create test jobs for test automation and integrate them with Continuous Integra- tion frameworks like Jenkins. Generate reports for quality analysis and inspection, making the development process more effi- cient and enabling the delivery of higher quality products at lower cost. Zombie Zombie Zombie Zombie Enterprise Network Master Timesys Remote Access Embedded Board Farm (EBF) and Test Automation Test Repository Test Reports & Logs Artifact Storage CI Master Build Slaves Build Environments Yocto Project Timesys Factory Source Code Repositories Embedded Linux Dev Environment T e s t A u t o m a t i o n E mbedded Boar d Farm D e v e l o p m e n t C o n t i n u o u s I n t e g r a t i o n Artifact Storage CI Master Build Slaves Reports Test Automation Service and Embedded Board Farm Customer Network Test Repository Package Sources Test Reports & Logs Zombie 1 Dev Boards Zombie 4 Dev Boards
2
Embed
Timesys Test Automation Solution (TAS) with …...Timesys Test Automation Solution (TAS) with Continuous Testing Built on open-source, and deployed behind your firewall Designed to
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Timesys Test Automation Solution (TAS) with Continuous TestingBuilt on open-source, and deployed behind your firewall
Designed to complement and extend your existing test infrastructure, TAS is composed of six major components that include:
• Remote Access Embedded Board Farm (EBF): Features APIs to integrate test automation frameworks and develop test cases for embedded devices
• Test Framework: Pre-integrated LAVA test automation framework, extensible and bundled with open-source test case templates, test job wizard for scheduling tests, and email notification of test job status
• CI System: Pre-Integrated with Jenkins, a Continuous Integration (CI) system, enables continual testing to reveal functional and performance regressions at Linux kernel, OS, and application levels
• Development Environment and Build Systems Integration: Pre-integrated with Yocto BSPs and Timesys Factory BSPs
• Test Case Management: Built-in with creation of test cases, test suites, and test plans, and importing of existing test case capabilities
• Report Management: Report generation in multiple formats, report comparison between test job runs, and import of test reports from other test frameworks
Develop new test cases, test suites and integrate existing test cases using Remote Access EBF APIs.
Create test jobs for test automation and integrate them with Continuous Integra-tion frameworks like Jenkins.
Generate reports for quality analysis and inspection, making the development process more effi-cient and enabling the delivery of higher quality products at lower cost.
Zombie
ZombieZombie
Zombie
Enterprise Network
Master
Timesys Remote Access Embedded Board Farm (EBF) and Test Automation
TAS comes with some pre-integrated components as well as APIs to enable easy integration of other components:
To learn more about the Timesys Test Automation Solution, email us at [email protected] or call us at 1.866.392.4897 (toll-free) or +1.412.232.3250 to schedule a compli-mentary, no-obligation consultation.
Benefits of the Timesys Test Automa-tion Solution include:
• Code quality — Ability to track and show consistency and measurable improvement in code quality by comparing results over time
• Functional regression — Ability to catch functional regression early in the development cycle
• Performance regression — Enables timely discovery of performance degradation vs. waiting for the QA/Validation cycle
• Continuous development — Inte-gration with Timesys Board Farm Cloud enables discovery of bugs and performance issues early in the development cycle
• Repeatability — Variability in testing methodology implicit with manual testing is eliminated
• Release ready — Reduces cycle time for release preparedness, important for bug fixes and vulnera-bility patches
• Summarized reports — Enables easy comparison of reports
• Easy integration with your existing workflow
• Build and source code manage-ment (SCM) system independent
• CI integration service• Track and trace — Documentation
to assist certification or internal audit for development maturity models
• Accessible via browser from anywhere• Continuous integration system plugins:
Jenkins- CI configuration policies- Artifact (build image) storage policies- Easy to integrate plugins for other CI
- Easy to integrate other SCM (SVN, ...) • Build system integration: Yocto, Factory
- Easy to integrate other build systems (Buildroot, Android, Soong, …)
• Test automation framework for pipelining and executing the tests: (LAVA, Squish*)- LAVA Test Jobs- Job Definition wizard- Create, View, Delete, Refresh & SaveAs- Sample YAML- API to submit Saved Test Job use by CI
(e.g. Jenkins)- Test execution over Serial and SSH- Job run across reboot (e.g. crashme)- Manual and automated scheduled exe-
cution- Test Job Run details and logs- Commandtine tests using shell on DUT
for output verification• Scheduling policy management (Jenkins,
manual)• Test repository (basic built-in)
- User Defined Tests- Test Editor- Import existing test scripts and binaries
• Test case templates- Iperf (network performance)- Lmbench (performance analysis)- Bonnie (filesystem performance)- Crashme- LTP (Linux Test Project)
• Device layer: 24x7 availability of boards with APIs for executing the automated tests (Timesys EBF)- Multi-user Support (login controlled)
• Enables multiple users to connect into the cloud simultaneously, while allowing each logged in user to control can use different boards con-nects into the cloud simultaneously
- APIs for automation• GPIO (bit or byte)• SD card switch• USB memory switch• USB hotplug• Ethernet hotplug