SMAART Sophisticated Mobile Application using Augmented Reality TECHNICAL REPORT SPRING 2011 Instructor: Dr.Kwok-Bun Yue Mentor: Mr.Dilhar De Silva Project Team Members: Nithin Kumar Dudde Manoj Gidda Shivani Kovvuri Srikanth Inapurapu Srikanth Majji (Team Leader) Report Date:
58
Embed
SMAART - dcm.uhcl.edudcm.uhcl.edu/caps11g5/tech.docx · Web viewACKNOWLEDGEMENT. We take an immense pleasure in expressing our sincere thanks to our instructor, Dr. Kwok Bun Yue,
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
SMAARTSophisticated Mobile Application using Augmented Reality
Technology
TECHNICAL REPORT
SPRING 2011
Instructor:
Dr.Kwok-Bun YueMentor:
Mr.Dilhar De SilvaProject Team Members:
Nithin Kumar DuddeManoj Gidda
Shivani KovvuriSrikanth Inapurapu
Srikanth Majji (Team Leader)Report Date:
29 April 2011
Sophisticated Mobile Application using Augmented Reality Technology
ACKNOWLEDGEMENT
We take an immense pleasure in expressing our sincere thanks to our instructor, Dr. Kwok Bun
Yue, for providing us with valuable feedback throughout the capstone project. We really
appreciate his advice, support, and feedback.
We are very much grateful to our mentor, Mr. Dilhar De Silva, for his inspiring guidance and
advice throughout our project. Mr. Dilhar De Silva has been the inspiration and was always up
front to motivate and encourage us for bringing out our project successfully. We would like to
thank him for his excellent technical expertise, guidance, support, and time.
Finally we extend our thanks to each of our families, who gave us encouragement whenever we
had a tough time.
Capstone Spring 2011 2 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
ABSTRACT
In today’s world, mobile applications are triggering a fundamental shift in the way people
experience computing and use mobile. The explosive growth in smartphones in the last three
years facilitated the development of hundreds of thousands of mobile applications that promised
to fundamentally change how people use the Web. Our mentor, Mr. Dilhar De Silva, CEO of
AtLinks Communications, was interested in developing an android mobile prototype application
using augmented reality technology.
The overall goal of the project is to develop an Android-based augmented reality (AR) mobile
application through which images and text can be placed on top of the objects of the phone
camera view based on the geo-location of the objects detected by the phone. For example, using
this application, administrative user can place the schedule of the event at a particular geo-code
(latitude and longitude) on a server by using a web application and the mobile users can open the
mobile application on android phone to view the augmented image of schedule overlying on
camera’s view. Mobile user can also download the schedule into their mobile phones by
providing their login credentials.
To provide the necessary AR functionality, our team developed and used a metric to study about
AR API’s and selected QUALCOMM API for pattern based augmentation, and WIKITUDE API
for geo-code based augmentation.
This project was carried out in accordance with Rational Unified Process (RUP), using Scrum
process. The process went iteratively and incrementally delivering sprints and finally delivering
the end product. The project will be documented using UML 2.0.
Capstone Spring 2011 3 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
CONTENTSACKNOWLEDGEMENT 2
ABSTRACT 3
1. INTRODUCTION 5
1.1 Purpose 5
1.2 Overview 5
2. SOFTWARE DEVELOPMENT MODEL 8
3. DESIGN AND IMPLEMENTATION 10
3.1 Architecture diagram: 10
4. TECHNICAL DETAILS 13
5. Technical Challenges and Lessons Learnt 14
5.1 Selection of Android Mobile phone 14
5.2 Selection of Augmented Reality Browser/Engine 14
6. CONCLUSION 15
7. FUTURE WORK 15
8. REFERENCES 16
9. APPENDICES 17
Appendix A: Project Management and Team Information 17
4. Category: Each image which is placed at a particular geo-location by an Authorized user
has a related Category Name.
Column Name DataType Default Value
CategoryID interger[15] Not Null
CategoryName varchar[45] Not Null
Capstone Spring 2011 24 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Primary Key: {CategoryID}
Functional Dependency: CategoryID CategoryName
Highest Normal Form: BCNF
Appendix E: Use case and Sequence Diagrams
Use case Diagram:
Client side:
Capstone Spring 2011 25 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Kite level written Use Case for displaying images in a virtual world using Augmented Reality technology:
Use-Case Title: Displaying images in a virtual world using Augmented Reality technology
Primary Actor: Mobile User
Level: Kite (Summary)
Stakeholders: Mobile user
Precondition: Mobile users should have a camera phone with android operating system
Minimal guarantee: Mobile users retrieve the geo codes facing camera lens
Success guarantee: Display images at the specific geo code on camera
Trigger: Mobile users access the application utilizing Augmented Reality technology
Main success scenario:1. Mobile Users opens the Augmented Reality application on Android phones using camera
lens to retrieve the geo code locations.2. Mobile Users requests server for the images by sending the geo codes.3. Images are displayed at corresponding geo code locations on camera after receiving it
from the server database.4. Images can be maximized by touching it.5. Images can be downloaded and stored in to the mobile phone.
Error conditions:1. a. Sending geo codes to the server is interrupted
1.a.1 Transaction Rolled back, Mobile User starts again. 1.a.2 Transaction Rolled back, Mobile User quits.
2. a. Receiving images from server is interrupted 2.a.1 Transaction Rolled back, Mobile User starts again. 2.a.2 Transaction Rolled back, Mobile User quits.
3. a. If images are not downloaded 3.a.1 Transaction Rolled back, Mobile User starts again. 3.a.2 Transaction Rolled back, Mobile User quits.
Capstone Spring 2011 26 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Server side:
Capstone Spring 2011 27 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Kite level written Use Case for adding and updating images on server side GUI:
Use-Case Title: Adding and updating Images on Server side GUI
Primary Actor: Authorized user
Level: Kite (Summary)
Stakeholders: Authorized user
Precondition: Server side GUI should be embedded with Google maps API.
Minimal guarantee: Accessing the Google maps from server side GUI with internet
Success guarantee: Adding images at the specific geo code location on server side
Trigger: Administrator access the GUI enabled with Google maps API
Main success scenario:1. Administrator logs in to access the server side GUI.2. Pick a geo location to add an image.3. Add images at specific geo code locations using Google maps API.4. Update all the images with the recent one.5. Maintain the server side GUI regularly.
Error conditions:1. a. “Log-in” Use case failure
1.a.1. Authorized user is told the account information is invalid, Authorized user provides the valid information and login successfully.
2. a. Adding images at Geo codes are interrupted 2.a.1 Transaction Rolled back, Administrator starts again. 2.a.2 Transaction Rolled back, Administrator logs out.
3. a. Updating images are interrupted. 3.a.1 Transaction Rolled back, Administrator starts again. 3.a.2 Transaction Rolled back, Administrator logs out.
Capstone Spring 2011 28 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Sequence Diagram:
Client side:
Sequence diagram for selecting the category:
Capstone Spring 2011 29 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Sequence diagram for setting radius and perform camera options:
Capstone Spring 2011 30 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Sequence diagram for authentication:
Capstone Spring 2011 31 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Sequence diagram for opening downloaded images:
Server side:
Capstone Spring 2011 32 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Sequence Diagram for successful login onto web application:
Sequence diagram for picking a geo location to upload an image:
Capstone Spring 2011 33 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Sequence diagram for adding image and choose category:
Capstone Spring 2011 34 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Appendix F: Screenshots of Client Side and Server Side
Server Side:
Capstone Spring 2011 35 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Fig 1: Home Page
Fig 2: Login Page
Capstone Spring 2011 36 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Fig 3: Registration page
Fig 4: After successful login the user can place a marker on the Google Maps and upload an image.
Capstone Spring 2011 37 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Client Side:
Images of application running on Dell Streak
Fig 5: Initial Screen
Fig 6: Screen when clicked on menu
Capstone Spring 2011 38 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Fig 7: Screen with list of categories
Fig 8: Screen when clicked on Camera
Capstone Spring 2011 39 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Fig 9: Screen when clicked on Map
Fig 10: Screen when tapped on the marker. Login page
Capstone Spring 2011 40 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Fig 11: Screen when clicked download after successful login
Fig 12: Screen when clicked on info menu button
Capstone Spring 2011 41 | P a g e
Sophisticated Mobile Application using Augmented Reality Technology
Fig 12: Screen when clicked pattern recognition in camera button
Fig 13: Screen when clicked on Geolocation on Camera menu button