Content

1. 2. 3. 4. 5. Introduction .. 3 Aim and Objective . 4 Product Research .... 5 Critical Analysis ..... 5 Design Methodology .. 6-11 Overview of hardware setup Hardware Overview Distance & Reflection Sensing Image sensor LCD module Image processor Microcontroller alarm system Software Overview Project Specification . 12 Cost .... 12 Gantt Chart 13 References . 14

6. 7. 8. 9.

1|Page

Introduction
Motorcycle accidents are particularly dangerous hazard in the world. In the world trend, motorcyclist deaths are continued to increase, due to the driver inattentiveness and blind spot to the side of the vehicles. Blind spot? It refers to the area that invisible to the drivers viewpoint, which driver cannot be seen when looking in their mirrors. So, the Motorcycle Blind Spot Camera is the system that helps the motorcyclist to avoid a crash with neighbouring vehicles by continuously screening the blind spot side of the vehicles and issued a warning signal when an object is detected. It provides a greater safety to the motorcyclist compare to the traditional rear-view mirrors. This system will use the sensors to determine the position of the objects that around the motorcyclist and capture the images reflected to a mirror or video display; warn the motorcyclist when an object detected. The warning signal would vary from one version to another visual or audio signal. As a consequence, the driver can control the vehicles effectively.

2|Page

Aims & Objective

The project aims to uses the radar or camera technologies to monitor the blind spot area of the vehicle; sensing or detecting the objects surrounding the motorcyclist, sending or receiving the live feeds blind spot of the vehicle to the camera, perform an imaging analysis and audio indication upon objects detection of the blind spot area. Objectives to achieve: i) Learn on sensor detection, accuracy, range of distance measurement ii) Learn on CMOS Image Sensor iii) Learn on SSD1928 Image Processor/LCD controller iv) Learn on driving LCD module v) Learn on PIC programming, image acquisition, data conversion vi) Learn on alarm system indication vii) Learn the used of Microchip MPLAB Software, C32 complier viii) Learn the used of PICKit 2 programmer and debugger for Microchip microcontroller ix) Learn of C++ programming

3|Page

Product Research
Different blind spot detection device has been developed and available in the market, some of the models provide an additional warning to the riders to attract their attention on the blind spot detected.

Xiamen Autostar Blind Spot Assist System

Sensor LED Monitor area Detecting Distance Ultrasonic Frequency Working temperature Power consumption Operating voltage Alarm volume Features 2/4 sensor rear, 1 left, 1 right Built in pair LED light 0.3-3.0m 0.3-2.5m 40kHz -40C to +80C 1.8W 9-16V Blind Spot indication by color LED Warning tone indication of lane change which located inside blind spot area detection Sound frequency will alert as faster when closer Distance and position display Wide detection range:3.0m/120 Operating environment: Fog, darkness, rain, snow

Intelligent 4 eye Blind Spot Detection System

4 radar detectors Colorful VFD display with flashing sensor 0.3-2.0m 0.3-1.5m 40kHz -40C to +80C <5W 12V >80dB Unique ultrasonic resistance can filter environmental ultrasonic wave efficiently Detection range work by emitting step-up buzzer Noise suppression & cancellation technology Excellent flat shape of ultrasonic bean offer more precise readings

Critical Analysis
Comparison of the product research and specification of project target:
Sensor detection range, ultrasonic frequency range, power consumption

Warning tone, alarm indication, Product reliability and stability

Live feed of camera view

4|Page

Design Methodology
Overview of the hardware setup

Ultrasonic Sensor/Infrared sensor Object detection, distance calculation from the sensing range, reflection on sound/light waves

Camera OV9650 Low-power imaging devices that converts an optical image into electronic signal

Image processor/LCD Controller SSD1928 Interface with OV9650 camera and the display on the LCD panel

Microcontroller -Received image data from image processor -Configure operation and task -Perform image processing -Handle all communication with PC -Blind Spot Decision

3.5 LCD Display Color TFT LCD module with touch panel integrated Alarm System LED/audio alert generate

5|Page

Hardware Overview
Distance & Reflection Sensing:
Infrared Sensor/ Ultrasonic Sensor Infrared sensor consists of the IR emitter sends out the IR light and IR detector checks the reflections of the light that bounced off by the objects detect. The IR sensor determines the distance of an object based on the measurement amount of time on the light takes and return to the detector. The more light will reflected as the closer and object to the sensor. It could detect an object up to 5 feet away while basically recommended for the used of short distances detection only. Therefore, ultrasonic sensor being consider for farther distance range detection. The ultrasonic sensor will calculate the distance based on the high frequency sound waves that reflected off nearby objects. This ultrasonic sensor might required microprocessor to both send and received a signal.

Figure above shows the ranging measurement of object detection. It targeted to detects an object 6 from the sensor and moving to 10. It will continuously calculate and output as long as there is changes of the distance. It measure precise distance of an object moving to and from the sensor via time intervals between the transmission and reflection burst of the ultrasonic sound.

6|Page

Hardware Overview
Image sensor:
Omni Vision OV9650 CMOS Sensor (1.3 MPixel, 3.3V operation) This is the low operating voltage CMOS image sensor which required only 3.3V operation voltage. It consists of an active image array of 1300 columns by 1028 row (1.3MPixels) and Analogue Signal Processor that performs all analog image functions such as Automatic Gain control and Automatic White Balance. The signal will fed into two 10-bit Analog-to-Digital Converters after the analog processing block via two multiplexers. This ADC will perform Analog-to-Digital conversion and allowed the user to adjust the final image brightness upon the combination of A/D Range Multiplexer and A/D Range Control set. After the A/D conversion, the signal will feed into the Digital Signal Processor. The DSP will control the interpolation from the RAW data to RGB and the image quality control and sending all the data to the output formatter for image reading send out.

This CMOS image sensor is widely used in picture phone application and digital still camera application as it capable doing the own pre-processing. Therefore, it is suitable to use in the Blind Spot Camera Detection. The user can completely control the image quality, formatting and output the data transfer.

7|Page

Hardware Overview
2

LCD Module:
LCD module (Display smaller than 3/Larger than 3.5) There are various LCD modules available. Generally, smaller display which less than 3 usually drive by built-in controller while the LCD panel which larger than 3.5 would requires an external graphic controller. This external LCD controller relieve to the microcontroller from graphics manipulation and image processing. Hence, SSD1928 image processors chosen as it have the LCD controller which supports the digital LCD panels with configurable timing signals.

Image processor:
Solomon SSD1928 Image Processor/LCD Controller The image data sent from the camera sensor via the CMOS Sensor Interface (CSI) module. This image processor SSD1928 used as the decoder engine for OV9650 Image Camera Sensor. It offer camera input port, image processing unit and hardware JPEG codec to encode the captured image into JPEG file. The CMOS camera is connect to image capture interface and image captured will store into the embedded memory. This image processor is able to interface with different types of generic microcontroller as low as 8-bit. It will share the load from main processor as follows: Interface with OV9650 camera Interface with display on LCD panel Store picture in RGB format on chip image buffer Continuously update the LCD and on chip image buffer from camera according to the frame rate

8|Page

Hardware Overview

Microcontroller:
Microcontroller The microcontroller needs to be interfaced with a special co-processor, image processor of SSD1928 the overcome its own memory limitation. The SSD 1928 will takes the loads off the main processor so it can fully utilize the resources to perform any type of signal/image processing. The main processor will perform the task as below: Configure the co-processor SSD1928 operation and tasks Collecting/receiving the image data from the co-processor SSD1928 image buffer Perform the image processing and stored the image to image bugger prior the ready display on LCD Handle all the serial communication with PC on sending out the image data

Alarm System:
Buzzer with transistor Buzzer will produce a tone when a voltage is applied and current passed through. It could be control by a NPN/PNP transistor. The transistors were acts as an open switch when there is no current though the base, the buzzer will off. The buzzer will buzzes as the transistor acts like a closed switch when there is the current passed through.

9|Page

Software Overview
Programming with MPLAB:
Hardware programming handles by MPLAB C Complier for the Microchip 16-bit devices.

Program Flow Chart:

Object detected

Distance calculation Initialize image processor In critical zone?

No
Initialize camera using image processor

Yes
Zone 1<2m?

Yes Yes

Turn ON LED 1 Turn ON LED 1,2

Configure LCD controller to update LCD from camera

No
Zone 2<1.5m?

Store picture on chip image buffer

No
Zone 3<1m?

Yes Yes

Turn ON LED 1,2,3

Continuously update LCD and on chip image buffer from camera

No
Zone 4:0.5m?

Turn ON LED 1,2,3,4

Yes

Alarm system ON
Reach 3mins?

Yes
Alarm OFF RESET

10 | P a g e

Project Specification
General project specification target as below:

Operating voltage Sensor Type Detecting distance Operating Environment Image Sensor Video System Alarm duration Alarm indication Alarm volume

Specification DC 9V Ultrasonic Sensor 0.3m-2.0m 0-40C (5C) 1.3MPixels Color CMOS Image Sensor 3.5 QVGA 16.7M Color TFT LCD Module 0-3mins LED & audio warning Automatic

Project Costing
Cost Estimation:

List of component Ultrasonic Sensor Image sensor,OV9650 Image processor,SSD1928 3.5 LCD module Microcontroller, PIC32MX360F512L PIC KIT2 Ribbon cable LED Miscellaneous

Price(RM) 20 65 60 100 50 Nil 5 4 30

Quantity 1 1 1 1 1 1 2 -

Total(RM) 20 65 60 100 50 Nil 10 1 30

Total

336

11 | P a g e

Gantt Chart
Sept
19 26 3 10

Oct
17 24 31 7

Nov
14 21 28 5

Dec
12 19 26 2 9

Jan
16 23 30 6

Feb
13 20 27 5

Mar
12 19 26 2

Apr
9 16

1 2 3

Select title Project specification and risk assessment Literature research and project planning Research on detector Research on image camera Research on image processor Research on LCD module Research on microcontroller Research on buzzer

Hardware design & built Object detection Sensor comparison _ IR & Ultrasonic Distance calculation_0-2m CMOS image camera Image sense Interface with image processor Image processor Image acquisition & interface with LCD Interface with microcontroller Microcontroller Programming, image processing, LCD Blind spot decision Alarm system activation Software programming Hardware and Software interfacing, debugging Failure analysis Thesis compilation Project presentation

5 6 7 8 9

12 | P a g e

References
http://www.arm9board.net/download/OK6410/docs/datasheets/OV9650.pdf http://www.solomon-systech.com/pdf/AppNote_SSD1928_10.pdf http://www.techtoys.com.hk/Displays/LVC75Z779V1S/LVC75Z779.htm http://www.techtoys.com.hk/PIC_boards/PIC24-Eval-B2/appnotes/SSD1928%20Driver%20for%20B2.pdf http://www.societyofrobots.com/member_tutorials/node/71 http://www.microchip.com/en_US/family/16bit/ http://tiger.ece.stevens-tech.edu/grp5/presentation.pdf http://tiger.ece.stevens-tech.edu/grp5/proposal.pdf http://www.edn.com/article/518225-Automobile_sensors_may_usher_in_self_driving_cars.php http://www.patentstorm.us/patents/5325096/description.html http://www.instructables.com/id/Hacking-Automotive-Ultrasonic-Sensors/ http://cache.freescale.com/files/32bit/doc/prod_brief/MPC5561PB.pdf http://www.theimagingsource.com/downloads/mt9v024.en_US.pdf http://www.cvel.clemson.edu/auto/systems/blind-spot-detection.html

13 | P a g e