Our group is tasked with the set up and implementation of all the electronics associated with the Lampbotics project. The ESD of the project is essentially the brain. It will control everything from servos to face tracking. The image below shows what jobs are to be done, how we have divided up those jobs and a rough timeline on when those jobs will be done.
This involves using OpenCV in a new way of detecting colours, this could be done in a number of ways. Currently it is to be done by detecting the Hue Saturation and Value(Brightness) also known as HSV. This HSV value detects the values and passes them to the colour control thread which will pass that value to an Arduino that looks after the implementation of the colours on the NEOPIXLE LED’s.
Much like sprint one audio will concentrate on dynamic sound that will play as that lap moves. The audio will also include that ability to play pre-set sound effects when prompted to give the lap more emotion and life when in operation. Working with colour detect the lamp will be able to state witch colours it can see. With possible other reaction to the other vision detection components.
The audio code will be running on the pie found in the base of the lap this saves computing power needed on the head pie. It is also adventitious to have it on this pie as it the board closest to the powered speakers being used that are found in the base.
Using the previous development of the face tracking an improved version of the implementation of the face tracking will be design in this sprint. The reason behind implementing an improved version of the face tracking is due to two reason which are to improve the detection of faces at different angles and to also include face renegotiation into the design. By improving the face detection algorithm this will allow any unwanted jitter to be eliminated where this jitter is one of the causes of the unpredictable behaviour of the servos. To improve the face detection process multiple face cascades maybe implemented and trained face cascades may also be used to improve this process. Additional the added section of face recognition will also be implemented in the design for this sprint which may possible use a data base to compare know faces to implement this process.
Master Threads and Testing
This section will be the implementation of the Master Thread. It will consist of making sure everyone implements the correct procedure for the access and distribution of the various information required for the control of the Lampbotics project. In tune with this a testing thread will be created that will simulate the various pieces of information in order to test the functionality of the various processes out of circuit in a controlled environment.
This process will include the implementation of the inter-pi communications as there will be one pi in the base and one in the head. It could include two thread's that communicate between each other over a network. This will see the research and development of the communications channel be it wireless or networked together through a LAN connection.
The object detection module will see the usage of OpenCV in yet another way. Shapes will be created such as squares, triangles etc. These will then be detected and outputs can be flashed on screen. Using this in conjunction with the colour detection can see the implementation of a small interactive game that can be played that will see the user asked to present a specific shape with a colour. If this object is the correct colour and shape then the lamp could accept through motions of the head and a green light where if it is not correct it could indicate this through different motions and a red light.
GUI Touch Screen
This application includes the development of a simple user interface that will allow for the user to select which vision protocol to initialise. It can relay information to the user through text and pictures confirming choices made and the outcome of the visions software. the system will use a 7 inch touch screen for a slim and discrete design. The screen will be mounted on the front of the base for easy access. This will allow the overall system to be just plug in and play as no external connections will be needed on start up bar power.