Flashback Group 22

Slide 1

Marlon De La Cruz (EE)Rene Martinez (CpE/EE)Trenton Reed (EE)Marlon Smith (CpE)FlashbackGroup 221What is Flashback (Patent Pending)

2Goals and MotivationPatent PendingGain ExperienceARM / Linux DevelopmentQt / C++ GUISet Top Box ApplicationPCB DesignTo Enhance the Viewing ExperienceGraduation

3RequirementsProcess videos of at least 24 frames/secAccurate video and audio syncingMPEG-2 supportEvent controllerNon-Invasive user interfaceTwo channel video playbackProcess OTA Transmitted Channels4Software SpecificationsCommercial Detection < 1.0 sGUI Responses < 0.5 sChannel Switching < 3.0 sLive TV lag < 5.0 s5Hardware Specifications512 MB of Ram1 GHz clock16 GB storage deviceTV Tuners process 6 MHz bandwidth channels38.8 Mbps Data throughputStandard Definition Video Filter Gain > 6 dBAudio SNR > 72 dB

6Hardware Peripherals10/100 EthernetTwo USB 2.0 Type AUSB Mini Type B Digital Visual Interface Digital Only (DVI-D)Composite VideoRight and Left Audio ChannelPower Supply7-Segment DisplayOvero TidalStormMicroSDFanInfrared Sensor7Schematic Overview

8Processor ImplementationOMAP4470TMS320DM8168 (DaVinci)ARM1176/BCM2835AM335xDM37309MicroprocessorNameCostSpecsGPIOs AvailableSufficient DocumentationTMS320DM8168$149.00-ARM Cortex A8-up to 1.35 GHz-2 GB RAM1031YesARM1176JZF-SBCM2835N/A-up to 1 GHz-JTAG debug support21NoAM355x$34.00-up to 1 GHz-Linux, Android and Windows Embedded CE-2 USB OTG ports-ARM Cortex A867YesDM3730

$46.00-ARM Cortex A8-up to 1 GHz-Linux, Android and Windows Embedded CE-Multiple USB OTG ports

140Yes10Dev BoardsRaspberry Pi

BeagleBone Black

OVERO TidalSTORM

11TidalSTORM Connectors

12TV Tuner

13TV Tuners: USB-A Input

14TV Tuners: USB-A Input

15TV Tuners: USB Control

16TV Tuners: USB HubUSB2514 by SMSCUSB 2.0 Compatible4-Port HubEnhanced EMI rejection and ESD protection

17DVI-D

18DVI-DTexas Instruments: TFP410IC InterfaceEnhanced PLL Noise ImmunityNo HSYNC Jitter AnomalyNegligible Data-Dependent Jitter24-bit True Color Pixel Format

19SD Video Filter

20SD Video FilterTexas Instruments: THS7315Butterworth 5th Order LPF 8.5 MHz (-3dB)14.3 dB GainSupports Composite and S-Video Output

21Audio

22AudioTexas Instruments: DRV601SNR 105 dBLow Noise and Total Harmonic DistortionPop Reduction Circuitry

23IR Receiver

24IR ReceiverTFBS 4711Supports data rates up to 115.2 kbit/sDistance up to 8 mMax Power Dissipation 250 mW

6 mm3 mm257-Segment Display

1.2 7-Segment DisplayIC InterfaceRequires 5V

26USB Mini-B

27USB Mini-BCommunicate via UARTKernel Load and DebugFTDIs FT232RQ USB UART ICUSB to Asynchronous Serial Data Transfer InterfaceUSB Protocol on ChipUSB 2.0 Full Speed Compatible

28

Ethernet

29EthernetLoad Flashback to BoardDebug Flashback Functionality in Real-TimeSMSCs LAN9221 Ethernet ControllerIntegrated Ethernet MAC and PHY10BASE-T and 100BASE-TX support

30Power: 6V to 5V and 3.3V

31Power: 5V and 3.3VTIs TPS6211x Step Down Converter3.1V to 17V Input RangeUp to 1.5A Output CurrentTPS62111 Fixed Output 3.3VTPS62112 Fixed Output 5VOver-temperature and Over-current Protection

32Power: 3.3V to 1.8V

33Power: 3.3V to 1.8VMICRELs MIC5247 Linear RegulatorOutput Voltage 1.8V150mA Output CurrentThermal Shutdown

34Power: USB

35Power: USBUSB Hub Power: ENPIRIONs EP5368QISynchronous Buck Converter2.4V to 5.5V Input Voltage700mA Output Current3.3 V OutputShort Circuit and Over Current Protection

USB Power Switch: TPS2052BPower Distribution Switch2.7V to 5.5V Input and Output Range500mA Output CurrentThermal and Short-Circuit Protection36Linaro Ubuntu 12.10 LTSLinux Kernel v3.2+Desktop EnvironmentQt SupportFFMPEGOpenCVCommunity SupportFamiliarity

37Software Development (IDE)Qt Creator

38QtCreatorCross Platform CompatibleProgramming Language: C++GUI development formsOpenCV and FFMPEG compatible

39GUI Design

40OpenCV and FFMPEGWe elected to use OpenCV and FFMPEG.Extensive documentation on OpenCV and FFMPEG.Easier to create our implementation of a media player with more control over the audio and video streams.Cross platform and compliable on different architectures

41

42Software Class Diagram

43Class Interaction

Class Interaction

Class Interaction

Detection AlgorithmsBlack ScreenLogo absence detectionHigh Cut Rate detection47Black Screen DetectionBlack Screen: Pixel value threshold of 200,000Algorithm samples every 100 FramesLocation of logo is omitted from analysis

48

Logo Absence DetectionA database of known station logos with their coordinates will be stored in memory.Each logo will be accessed by key value.Using OpenCV, the image is normalized and then the difference is takenSum >115,000, no logoSum < 115,000 Logo49High Cut Rate DetectionCut Rate - difference in pixel density between two or more framesHigh cut rates indicate rapid change in pixel densities between frames.Using the standard deviation between the pixel densities we can determine commercial breaks.50Recording

51Work Distribution: HardwarePCB Design and Layout (per component)

52Work Distribution: Software

53BudgetComponentsDescriptionQuantityCost Development Board Tidal Storm, EEPROM, and Connectors3 $ 144.98 HDMI IC's and Connector3 $ 2.70 LCD Screen and Connector1 $ 19.45 PCB PCBN/A $ 356.58 Power IC's, Connector, and Inductors10 $ 17.06 RCA IC's and Connector3 $ 2.51 Summit Prototype Board Summit Prototype BoardN/A $ 49.00 TV Tuner Two Tuners, IC's, Crystal, and USB-A Connectors4 $ 160.24 Debug Ethernet and USB mini B7 $ 23.15 Eagle License Eagle LicenseN/A $ 169.00 Fan Fan and Connector1 $ 15.77 Capacitors Capacitors96 $ 20.51 Choke Filters Choke Filters6 $ 2.54 ESD ESD9 $ 4.24 Ferrite Beads Ferrite Beads21 $ 0.75 IR IR1 $ 4.32 LED LED1 $ 1.13 Resistors Resistors84 $ 7.02 Switches Switches2 $ 1.45 Total252 $ 1,002.39 Budget $ 1,000.00 54Questions55tv tunerSI LabsSi2177CrestaTechCTC703HauppaugeWinTV-HVR 950QAVerMediaH826TV TransmissionStandardNTSCATSC/QAMPAL/SECAMDVBT2/T/C2/CISDB-T/CDTMBNTSCATSC/QAMPAL/SECAMDVB-T2/T/C2/CISDB-TNTSCATSC/QAMNTSCATSC/QAMDemodulatorHybridAnalogHybridHybridEncoderN/AN/AMPEG-2MPEG-2H.264InterfaceICICUSB 2.0USB 2.0Remote ControlIncludedN/AN/AYesNoCost$1.93FREE$80.12$49.99

Sheet2

Sheet3