Pedestrian crossing aid device for the visually impaired

Size: px
Start display at page:

Download "Pedestrian crossing aid device for the visually impaired"

Transcription

1 Pedestrian crossing aid device for the visually impaired Song Han Jun, Ponghiran Wachirawit Korea Advanced Institute of Science and Technology Department of Electrical Engineering, Daejeon, Republic of Korea I. Introduction and Related Works Loss of sight is considered to be the most severe sensory disability. 1,2 Regarding the statistical information, there are around 252,000 visually impaired (VI) people in South Korea. 3 Everyday those people face many difficulties including local navigation. Also, an inability to independently mobilize is listed as the most significantly barrier of daily life. 4 Especially, where dangerous activities can easily occur (e.g. crosswalk), the VI who mostly rely on surrounding crowds and sound signaling systems may have a hard time. Considering the fact that sound generating system are installed only 7.2% of crosswalks in South Korea and 46.9% of those lack of regular maintenance 5, possibility of safe crossing is remarkably low. Figure 1 shows sound generating systems with poor maintenance. Figure 1 Sound signaling system with poor maintenance In recent years, several researches have been carried on to enhance pedestrian safety. The technology based on electronic devices to enhance individual safety in travel is commonly known as electronic travel aids (ETA). Many approaches has been proposed to convey user s surrounding space, including ultrasonic sensor 6,7, global positioning system 8,9,10, radio-frequency identification based position measurement system 11,12, and computer vision 13,14,15. Though numerous researches have accomplished to aid the VI so far, those ETAs cannot fully overcome navigation concerns due to their drawbacks. The evaluation of ultrasonic sensor based systems revealed that it generates many excessive feedbacks that draw user s attention. 16 The geographic informationbased system is highly dependent on prior location knowledge; as a result, information-based system can be used on specific areas. Also, there is no well-established framework for computer vision based system. Thus, this research aims to establish a real-time robust visual object detection algorithm and develop a pedestrian crossing aid device based on that algorithm. The aid device complements the use of a guiding cane, providing the VI with brief recorded message to cross the road safely. II. Research question Which detector approach is the most suitable for detecting pedestrian signal on a mobile device? How can the road crossing behavior be understood and how can the position obtained from the detector be used to deliver the VI essential information to cross the road safely? 1

2 III. Method A. System overview An illustration and flow chart of the pedestrian crossing aid system is shown in figure 2. It contains three important processes, namely a candidate selection, a pedestrian signal verifier, and a decision scheme. Candidate selection picked out all possible candidates of pedestrian signal and sent their corresponding position to the pedestrian signal verifier. The pedestrian signal verifier confirmed the existence of the pedestrian signal and discarded all mismatched candidates. Then, the coordination of the pedestrian signal was sent to decision scheme for determining an appropriate speech output. The detailed information of each process can be found in the following section. Figure 2 Pedestrian crossing aid device illustration and flowchart B. Object detection framework In order to develop the crossing aid device, object detection is a critical process to obtain a position of the pedestrian signal from input image. Choosing an inappropriate detector can greatly affect the real-time performance and user s safety. In this research, a combination of top-down and bottom-up detection method was used. This is due to the fact that using either top-down or bottom-up detection alone has several drawbacks 17 and integration of these two can effectively provide real-time speed as well as detection accuracy. So far, there have been several attempts to combine top-down and bottom-up approaches. 18,19,20 Those approaches commonly use top-down detection to reduce searching area and bottom-up detection to find the object of interest. In this research, similar framework was replicated by using candidate selection as top-down approach and pedestrian signal verifier as bottom-up approach. C. Candidate Selection Candidate selection is the first process that was applied to an input frame. This process selected the candidates of pedestrian signals based on their color properties using threshold segmentation. Firstly, candidate selection partitioned an image into non-overlapping regions. 22 In this work, the region was defined as a homogenous group of connected pixels with respect to their color properties in HSV color space. Secondly, regions with similar color properties of pedestrian signals were considered as possible candidates while mismatch areas were neglected and no longer used for further computation. To accurately detect pedestrian signals, 200 samples of pedestrian signals were selected at different backgrounds for statistical reference. Furthermore, the characteristic parameters were 10% increased to prevent the loss of the detecting target. Lastly, a set of the possible positions was returned as a result of the candidate selection. The set included both true and false detections, but the false detections were removed through the following pedestrian signal verifier. 2

3 D. Pedestrian Signal Verifier In order to achieve an effective recognition for various pedestrian signals, machine-learning-based detection was employed to confirm the signals. Machine-learning based detector can be trained to handle multiple pedestrian signals at different shapes and sizes. In this research, local binary pattern (LBP) was selected as a detection feature. LBP outperforms many other features in terms of precision and is widely used in various applications, e.g., face detection 23. Even though LBP has a slightly lower detection accuracy than a traditional Haar feature, LBP requires less computation cost and is suitable for limited resource hardware like an embedded system. At the beginning LBP of pedestrian signals were trained by a cascade of classifiers called AdaBoost. AdaBoost was adopted to increase detection performance and reduce computation time. Afterwards a robust realtime machine learning detector was given. This detector searches all the candidates obtained from the candidate selection and instantly rejects all mismatched ones. If searching-windows matched with the trained criteria, the same procedure was repeated with tighter constraints for a certain time. At the end the position of a pedestrian signal was obtained and used by the decision scheme for generating a guiding message. Figure 3 shows the process of detection framework. Fig 3 Process of object detection framework E. Decision Scheme After successfully locating a pedestrian signal in an input frame, two tasks of decision scheme were conducted. One was identifying light color and another was deciding an appropriate response for the VI. Because both green and red lights have unique color properties, threshold segmentation was again employed, but with different constraints. A light color was considered to be either green or red if the light color properties in HSV color space fell in a certain range. The statistical references of HSV ranges were calculated from 200 samples of lights at different illuminations. Based on the collection of data, it was found out that a green color covers a range from H=70, S=40, V=150 to H=90, S=255, V=255 and a red color covers a range from H=0, S=80, V=150 to H=6, S=255, V=255. Figure 4 shows examples of pedestrian signals after thresholding with the HSV ranges of green and red colors. Figure 4 Examples of pedestrian signal after thresholding with green and red color 3

4 As soon as the light color was interpreted, analysis of light changing pattern was performed as the final process of the system. For effectiveness, pedestrian crossing behavior was described by the finite state machine. Any change of the light color caused a transition from the one state to the others on the finite state machine. The next state was decided based on the present light color and previous information. For example, a change from red to green causes one who waits to start crossing. For each state transition, the system provided a brief message relevant to the transition for the VI. If there are any changes that violate possible transition behavior (e.g. change from red to blinking), the system goes to the safety state and informs the user to act accordingly. IV. Results and Discussion The pedestrian crossing aid device is currently in the developing state. However, the detection algorithm was successfully developed under C++ programming environment and OpenCV library. The algorithm was combined with simple version of decision scheme to test its functionalities. With an assumption that detection begins at crosswalk, the aid device effectively detected a pedestrian signal at real-time speed and was able to help a user cross the road safely. An evaluation shows that it has 77.3% object detection accuracy, 96.2% color interpreting accuracy, and 74.4% overall accuracy. Those numbers indicates that the proposed detection algorithm works in practice and the aid device can be further developed to increase its reliability. For the next step, this crossing aid program should be developed to be compatible with a mobile device. Furthermore, additional program features such as depth detection, and geographic information should be combined to increase the user safety in traveling. V. Relevance in ICCHP context The crossing aid device aims to overcome navigation concerns for the VI especially at the crosswalk where accident can easily occur. By employing several computer vision techniques and automation system, we focus to bring out today s potential technology to support the VI in everyday life. VI. References 1. Engelberg, Alan L. Guides to the evaluation of permanent impairment. American Medical Association, Strumillo, Pawel. "Electronic interfaces aiding the visually impaired in environmental access, mobility and navigation." Human System Interactions (HSI), rd Conference on. IEEE, Korean Ministry of Health and Welfare. Statistics Korea. Sectoral indicators, Web. 26 Dec < EachDtlPageDetail.do?idx_cd=2768>. 4. Bujacz, M., et al. "Remote mobility and navigation aid for the visually disabled."proc. 7th Intl Conf. on Disability, Virtual Reality and Assoc. Technologies with Art ArtAbilitation, in PM Sharkey, P. Lopesdos-Santos, PL Weiss & AL Brooks (Eds.) Korean road traffic authority. The Road Traffic Authority. Statistic of sound generating system in South Korea, Web. 23 Dec < 6. SShoval, Shraga, Iwan Ulrich, and Johann Borenstein. "NavBelt and the Guide-Cane [obstacle-avoidance systems for the blind and visually impaired]."robotics & Automation Magazine, IEEE 10.1 (2003): Ulrich, Iwan, and Johann Borenstein. "The GuideCane-applying mobile robot technologies to assist the visually impaired." Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on 31.2 (2001):

5 8. Loomis, Jack M., Reginald D. Golledge, and Roberta L. Klatzky. "GPS-based navigation systems for the visually impaired." (2001). 9. Mayerhofer, Bernhard, Bettina Pressl, and Manfred Wieser. "ODILIA-A Mobility Concept for the Visually Impaired." Computers Helping People with Special Needs. Springer Berlin Heidelberg, Ran, Lisa, Sumi Helal, and Steve Moore. "Drishti: an integrated indoor/outdoor blind navigation system and service." Pervasive Computing and Communications, PerCom Proceedings of the Second IEEE Annual Conference on. IEEE, Kulyukin, Vladimir, et al. "RFID in robot-assisted indoor navigation for the visually impaired." Intelligent Robots and Systems, 2004.(IROS 2004). Proceedings IEEE/RSJ International Conference on. Vol. 2. IEEE, Chang, Tsung-Hsiang, et al. "icane A partner for the visually impaired."embedded and Ubiquitous Computing EUC 2005 Workshops. Springer Berlin Heidelberg, Coughlan, James M., and Huiying Shen. "Crosswatch: a system for providing guidance to visually impaired travelers at traffic intersection." Journal of assistive technologies 7.2 (2013): Gnana Praveen, and Roy P. Paily. Blind Navigation Assistance for Visually Impaired based on Local Depth Hypothesis from a Single Image. Procedia Engineering. Vol Shen, Huiying, et al. "A mobile phone system to find crosswalks for visually impaired pedestrians." Technology and disability 20.3 (2008): Peng, En, et al. "A smartphone-based obstacle sensor for the visually impaired." Ubiquitous Intelligence and Computing. Springer Berlin Heidelberg, Wang, Liming, et al. "Object detection combining recognition and segmentation." Computer Vision ACCV Springer Berlin Heidelberg, Fidler, Sanja, et al. "Bottom-up segmentation for top-down detection." Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on. IEEE, Oliva, Aude, et al. "Top-down control of visual attention in object detection."image Processing, ICIP Proceedings International Conference on. Vol. 1. IEEE, Carreira, Joao, et al. "Semantic segmentation with second-order pooling."computer Vision ECCV Springer Berlin Heidelberg, Navalpakkam, Vidhya, and Laurent Itti. "An integrated model of top-down and bottom-up attention for optimizing detection speed." Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on. Vol. 2. IEEE, Glasbey, Chris A., and Graham W. Horgan. Image analysis for the biological sciences. New York: John Wiley & Sons, Ahonen, Timo, Abdenour Hadid, and Matti Pietikainen. "Face description with local binary patterns: Application to face recognition." Pattern Analysis and Machine Intelligence, IEEE Transactions on (2006): Song Han-Jun is a M.S. student in Unmanned System Research Group, Department of Aerospace Engineering at Korea Advanced Institute of Science and Technology (KAIST). He received his B.S. in Mechanical Engineering and Electrical Engineering as double major from KAIST in His research interests include Robotics and Autonomous System. Ponghiran Wachirawit is currently a B.S. student in Electrical Engineering at KAIST. His research interest focuses on Computer Architecture, SoC Design, and VSLI for Multimedia Application. 5

Assistive guidance system for the visually impaired Rohit Takhar 1, Tushar Sharma 1, Udit Arora 1, Sohit Verma 1 1

Assistive guidance system for the visually impaired Rohit Takhar 1, Tushar Sharma 1, Udit Arora 1, Sohit Verma 1 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 Assistive guidance system for the visually impaired Rohit Takhar 1, Tushar

More information

Real-Time Walk Light Detection with a Mobile Phone

Real-Time Walk Light Detection with a Mobile Phone Real-Time Walk Light Detection with a Mobile Phone Volodymyr Ivanchenko, James Coughlan and Huiying Shen The Smith-Kettlewell Eye Research Institute, San Francisco CA {vivanchenko, coughlan, hshen}@ski.org

More information

Application of Dijkstra s Algorithm in the Evacuation System Utilizing Exit Signs

Application of Dijkstra s Algorithm in the Evacuation System Utilizing Exit Signs Application of Dijkstra s Algorithm in the Evacuation System Utilizing Exit Signs Jehyun Cho a, Ghang Lee a, Jongsung Won a and Eunseo Ryu a a Dept. of Architectural Engineering, University of Yonsei,

More information

Design of a Pedestrian Detection System Based on OpenCV. Ning Xu and Yong Ren*

Design of a Pedestrian Detection System Based on OpenCV. Ning Xu and Yong Ren* International Conference on Education, Management, Commerce and Society (EMCS 2015) Design of a Pedestrian Detection System Based on OpenCV Ning Xu and Yong Ren* Applied Technology College of Soochow University

More information

#19 MONITORING AND PREDICTING PEDESTRIAN BEHAVIOR USING TRAFFIC CAMERAS

#19 MONITORING AND PREDICTING PEDESTRIAN BEHAVIOR USING TRAFFIC CAMERAS #19 MONITORING AND PREDICTING PEDESTRIAN BEHAVIOR USING TRAFFIC CAMERAS Final Research Report Luis E. Navarro-Serment, Ph.D. The Robotics Institute Carnegie Mellon University November 25, 2018. Disclaimer

More information

Neural Network in Computer Vision for RoboCup Middle Size League

Neural Network in Computer Vision for RoboCup Middle Size League Journal of Software Engineering and Applications, 2016, *,** Neural Network in Computer Vision for RoboCup Middle Size League Paulo Rogério de Almeida Ribeiro 1, Gil Lopes 1, Fernando Ribeiro 1 1 Department

More information

JPEG-Compatibility Steganalysis Using Block-Histogram of Recompression Artifacts

JPEG-Compatibility Steganalysis Using Block-Histogram of Recompression Artifacts JPEG-Compatibility Steganalysis Using Block-Histogram of Recompression Artifacts Jan Kodovský, Jessica Fridrich May 16, 2012 / IH Conference 1 / 19 What is JPEG-compatibility steganalysis? Detects embedding

More information

Step Detection Algorithm For Accurate Distance Estimation Using Dynamic Step Length

Step Detection Algorithm For Accurate Distance Estimation Using Dynamic Step Length Step Detection Algorithm For Accurate Distance Estimation Using Dynamic Step Length Ahmad Abadleh ahmad_a@mutah.edu.jo Eshraq Al-Hawari eshraqh@mutah.edu.jo Esra'a Alkafaween Esra_ok@mutah.edu.jo Hamad

More information

A System Development for Creating Indoor Floor Plan of Walking Route using Video and Movement Data 1 2

A System Development for Creating Indoor Floor Plan of Walking Route using Video and Movement Data 1 2 A System Development for Creating Indoor Floor Plan of Walking Route using Video and Movement Data 1 2-1771/1.10250 0-2763-2600 0-2763-2700 1 eu.vacharapol_st@tni.ac.th 2 saprangsit@tni.ac.th Android accelerometer

More information

Open Research Online The Open University s repository of research publications and other research outputs

Open Research Online The Open University s repository of research publications and other research outputs Open Research Online The Open University s repository of research publications and other research outputs Developing an intelligent table tennis umpiring system Conference or Workshop Item How to cite:

More information

Walking aids based on wearable/ubiquitous computing aiming at pedestrian s intelligent transport systems

Walking aids based on wearable/ubiquitous computing aiming at pedestrian s intelligent transport systems Walking aids based on wearable/ubiquitous computing aiming at pedestrian s intelligent transport systems T Kuroda 1, H Sasaki 2, T Tateishi 3, K Maeda 4, Y Yasumuro 5, Y Manabe 6 and K Chihara 7 1 Department

More information

A real time vessel air gap monitoring system

A real time vessel air gap monitoring system Journal of Physics: Conference Series A real time vessel air gap monitoring system To cite this article: D McStay and K Thabeth 2009 J. Phys.: Conf. Ser. 178 012038 View the article online for updates

More information

Pedestrian Protection System for ADAS using ARM 9

Pedestrian Protection System for ADAS using ARM 9 Pedestrian Protection System for ADAS using ARM 9 Rajashri Sanatkumar Dixit S.T. Gandhe Pravin Dhulekar ABSTRACT We developed pedestrian protection system by using haar cascade algorithm with Friendly

More information

Bicycle Safety Map System Based on Smartphone Aided Sensor Network

Bicycle Safety Map System Based on Smartphone Aided Sensor Network , pp.38-43 http://dx.doi.org/10.14257/astl.2013.42.09 Bicycle Safety Map System Based on Smartphone Aided Sensor Network Dongwook Lee 1, Minsoo Hahn 1 1 Digital Media Lab., Korea Advanced Institute of

More information

Advanced Test Equipment Rentals ATEC (2832) OMS 600

Advanced Test Equipment Rentals ATEC (2832) OMS 600 Established 1981 Advanced Test Equipment Rentals www.atecorp.com 800-404-ATEC (2832) OMS 600 Continuous partial discharge monitoring system for power generators and electrical motors Condition monitoring

More information

Autonomous blimp control with reinforcement learning

Autonomous blimp control with reinforcement learning University of Wollongong Research Online University of Wollongong Thesis Collection 1954-2016 University of Wollongong Thesis Collections 2009 Autonomous blimp control with reinforcement learning Yiwei

More information

Determining a Blind Pedestrian s Location and Orientation at Traffic Intersections

Determining a Blind Pedestrian s Location and Orientation at Traffic Intersections Determining a Blind Pedestrian s Location and Orientation at Traffic Intersections Giovanni Fusco, Huiying Shen, Vidya Murali and James M. Coughlan The Smith-Kettlewell Eye Research Institute, San Francisco,

More information

Education and Research

Education and Research Richard Wall University of Idaho http://www.ece.uidaho.edu/ee/digital/rwall/research/transportation/niatt.html edu/ee/digital/rwall/research/transportation/niatt html 1 Presentations Summary of activities

More information

Cricket umpire assistance and ball tracking system using a single smartphone camera

Cricket umpire assistance and ball tracking system using a single smartphone camera 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 Cricket umpire assistance and ball tracking system using a single smartphone camera Udit Arora

More information

Early Skip Decision based on Merge Index of SKIP for HEVC Encoding

Early Skip Decision based on Merge Index of SKIP for HEVC Encoding , pp.287-292 http://dx.doi.org/10.14257/astl.2016.139.60 Early Skip Decision based on Merge Index of SKIP for HEVC Encoding Jinwoo Jeong, Sungjei Kim, and Yong-Hwan Kim, Intelligent Image Processing Research

More information

Obtain a Simulation Model of a Pedestrian Collision Imminent Braking System Based on the Vehicle Testing Data

Obtain a Simulation Model of a Pedestrian Collision Imminent Braking System Based on the Vehicle Testing Data Obtain a Simulation Model of a Pedestrian Collision Imminent Braking System Based on the Vehicle Testing Data Bo Tang, Stanley Chien, and Yaobin Chen Transportation Active Safety Institute Indiana University-Purdue

More information

HIGH RESOLUTION DEPTH IMAGE RECOVERY ALGORITHM USING GRAYSCALE IMAGE.

HIGH RESOLUTION DEPTH IMAGE RECOVERY ALGORITHM USING GRAYSCALE IMAGE. HIGH RESOLUTION DEPTH IMAGE RECOVERY ALGORITHM USING GRAYSCALE IMAGE Kazunori Uruma 1, Katsumi Konishi 2, Tomohiro Takahashi 1 and Toshihiro Furukawa 1 1 Graduate School of Engineering, Tokyo University

More information

IDeA Competition Report. Electronic Swimming Coach (ESC) for. Athletes who are Visually Impaired

IDeA Competition Report. Electronic Swimming Coach (ESC) for. Athletes who are Visually Impaired IDeA Competition Report Electronic Swimming Coach (ESC) for Athletes who are Visually Impaired Project Carried Out Under: The Department of Systems and Computer Engineering Carleton University Supervisor

More information

2600T Series Pressure Transmitters Plugged Impulse Line Detection Diagnostic. Pressure Measurement Engineered solutions for all applications

2600T Series Pressure Transmitters Plugged Impulse Line Detection Diagnostic. Pressure Measurement Engineered solutions for all applications Application Description AG/266PILD-EN Rev. C 2600T Series Pressure Transmitters Plugged Impulse Line Detection Diagnostic Pressure Measurement Engineered solutions for all applications Increase plant productivity

More information

INTRODUCTION TO PATTERN RECOGNITION

INTRODUCTION TO PATTERN RECOGNITION INTRODUCTION TO PATTERN RECOGNITION 3 Introduction Our ability to recognize a face, to understand spoken words, to read handwritten characters all these abilities belong to the complex processes of pattern

More information

Self-Driving Vehicles That (Fore) See

Self-Driving Vehicles That (Fore) See Self-Driving Vehicles That (Fore) See Dariu M. Gavrila Intelligent Vehicles, TU Delft Berlin Tech.AD, March 5, 2018 Personal Introduction: Dariu M. Gavrila Born in Cluj (Romania) 1990 Doktoraal Degree

More information

Using sensory feedback to improve locomotion performance of the salamander robot in different environments

Using sensory feedback to improve locomotion performance of the salamander robot in different environments Using sensory feedback to improve locomotion performance of the salamander robot in different environments João Lourenço Silvério Assistant: Jérémie Knüsel Structure of the presentation: I. Overview II.

More information

Evaluation of the depth camera based SLAM algorithms

Evaluation of the depth camera based SLAM algorithms 21 12 2017 12 Electri c Machines and Control Vol. 21 No. 12 Dec. 2017 SLAM 1 1 2 1 1. 150080 2. 100190 : 3 ( SLAM), SLAM V2,RTAB-Map DVO SLAM, 3 SLAM SLAM, TUM ICL-NUIM, SLAM, SLAM, SLAM :, SLAM V2;, DVO

More information

Performance of Fully Automated 3D Cracking Survey with Pixel Accuracy based on Deep Learning

Performance of Fully Automated 3D Cracking Survey with Pixel Accuracy based on Deep Learning Performance of Fully Automated 3D Cracking Survey with Pixel Accuracy based on Deep Learning Kelvin C.P. Wang Oklahoma State University and WayLink Systems Corp. 2017-10-19, Copenhagen, Denmark European

More information

Title: 4-Way-Stop Wait-Time Prediction Group members (1): David Held

Title: 4-Way-Stop Wait-Time Prediction Group members (1): David Held Title: 4-Way-Stop Wait-Time Prediction Group members (1): David Held As part of my research in Sebastian Thrun's autonomous driving team, my goal is to predict the wait-time for a car at a 4-way intersection.

More information

D-Case Modeling Guide for Target System

D-Case Modeling Guide for Target System D-Case Modeling Guide for Target System 1/32 Table of Contents 1 Scope...4 2 Overview of D-Case and SysML Modeling Guide...4 2.1 Background and Purpose...4 2.2 Target System of Modeling Guide...5 2.3 Constitution

More information

A Bag-of-Gait Model for Gait Recognition

A Bag-of-Gait Model for Gait Recognition A Bag-of-Gait Model for Gait Recognition Jianzhao Qin, T. Luo, W. Shao, R. H. Y. Chung and K. P. Chow The Department of Computer Science, The University of Hong Kong, Hong Kong, China Abstract In this

More information

THe rip currents are very fast moving narrow channels,

THe rip currents are very fast moving narrow channels, 1 Rip Current Detection using Optical Flow Shweta Philip sphilip@ucsc.edu Abstract Rip currents are narrow currents of fast moving water that are strongest near the beach. These type of currents are dangerous

More information

Intelligent Decision Making Framework for Ship Collision Avoidance based on COLREGs

Intelligent Decision Making Framework for Ship Collision Avoidance based on COLREGs Intelligent Decision Making Framework for Ship Collision Avoidance based on COLREGs Seminar Trondheim June 15th 2017 Nordic Institute of Navigation Norwegian Forum for Autonomous Ships SINTEF Ocean, Trondheim

More information

Siła-Nowicka, K. (2018) Analysis of Actual Versus Permitted Driving Speed: a Case Study from Glasgow, Scotland. In: 26th Annual GIScience Research UK Conference (GISRUK 2018), Leicester, UK, 17-20 Apr

More information

Algorithm for Line Follower Robots to Follow Critical Paths with Minimum Number of Sensors

Algorithm for Line Follower Robots to Follow Critical Paths with Minimum Number of Sensors International Journal of Computer (IJC) ISSN 2307-4523 (Print & Online) Global Society of Scientific Research and Researchers http://ijcjournal.org/ Algorithm for Line Follower Robots to Follow Critical

More information

Petacat: Applying ideas from Copycat to image understanding

Petacat: Applying ideas from Copycat to image understanding Petacat: Applying ideas from Copycat to image understanding How Streetscenes Works (Bileschi, 2006) 1. Densely tile the image with windows of different sizes. 2. HMAX C2 features are computed in each window.

More information

Re-evaluating automatic metrics for image captioning

Re-evaluating automatic metrics for image captioning /mertkilickaya_ kilickayamert@gmail.com Re-evaluating automatic metrics for image captioning Mert Kilickaya, Aykut Erdem, Nazli Ikizler-Cinbis, Erkut Erdem Background source target f( = ( The cat sat on

More information

Advanced PMA Capabilities for MCM

Advanced PMA Capabilities for MCM Advanced PMA Capabilities for MCM Shorten the sensor-to-shooter timeline New sensor technology deployed on off-board underwater systems provides navies with improved imagery and data for the purposes of

More information

I2V applications for cooperative automated driving and traffic management

I2V applications for cooperative automated driving and traffic management I2V applications for cooperative automated driving and traffic management Dr. Jaap Vreeswijk MAP traffic management, the Netherlands Interactive Symposium on Research & Innovation for Connected and Automated

More information

Decompression Method For Massive Compressed Files In Mobile Rich Media Applications

Decompression Method For Massive Compressed Files In Mobile Rich Media Applications 2010 10th IEEE International Conference on Computer and Information Technology (CIT 2010) Decompression Method For Massive Compressed Files In Mobile Rich Media Applications Houchen Li, Zhijie Qiu, Lei

More information

Object Recognition. Selim Aksoy. Bilkent University

Object Recognition. Selim Aksoy. Bilkent University Image Classification and Object Recognition Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Image classification Image (scene) classification is a fundamental

More information

Deakin Research Online

Deakin Research Online Deakin Research Online This is the published version: Lazarescu, Mihai and Venkatesh, Svetha 2003, Using camera motion to identify different types of American football plays, in ICME 2003 : Proceedings

More information

Reduction of Bitstream Transfer Time in FPGA

Reduction of Bitstream Transfer Time in FPGA IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 9, Issue 2, Ver. III (Mar - Apr. 2014), PP 82-86 Reduction of Bitstream Transfer Time in

More information

Department of Computer Science and Engineering The University of Texas at Arlington. Team: PAINTeK. Project: Sentinel

Department of Computer Science and Engineering The University of Texas at Arlington. Team: PAINTeK. Project: Sentinel Department of Computer Science and Engineering The University of Texas at Arlington Team: PAINTeK Project: Team Members: Ryan Bell Eric Cleveland Sean Pierce Robert Wunderlich Last Updated: June 14, 2012

More information

siot-shoe: A Smart IoT-shoe for Gait Assistance (Miami University)

siot-shoe: A Smart IoT-shoe for Gait Assistance (Miami University) siot-shoe: A Smart IoT-shoe for Gait Assistance (Miami University) Abstract Mark Sullivan, Casey Knox, Juan Ding Gait analysis through the Internet of Things (IoT) is able to provide an overall assessment

More information

Modeling and simulation of multiple personal mobility. vehicles in pedestrian flows using personal space

Modeling and simulation of multiple personal mobility. vehicles in pedestrian flows using personal space J. ADV. SIMULAT. SCI. ENG. Vol., No., 55-7. 5 Japan Society for Simulation Technology Modeling and simulation of multiple personal mobility vehicles in pedestrian flows using personal space Thai Quoc Pham,*,

More information

Controlling Walking Behavior of Passive Dynamic Walker utilizing Passive Joint Compliance

Controlling Walking Behavior of Passive Dynamic Walker utilizing Passive Joint Compliance Controlling Walking Behavior of Passive Dynamic Walker utilizing Passive Joint Compliance Takashi TAKUMA, Koh HOSODA Department of Adaptive Machine Systems, Graduate School of Engineering Osaka University

More information

Development of Biomimicry Wind Louver Surface Design

Development of Biomimicry Wind Louver Surface Design International Proceedings of Chemical, Biological and Environmental Engineering, V0l. 93 (2016) DOI: 10.7763/IPCBEE. 2016. V93. 6 Development of Biomimicry Wind Louver Surface Design Jaepil Choi 1, Donghwa

More information

Look Up! Positioning-based Pedestrian Risk Awareness. Shubham Jain

Look Up! Positioning-based Pedestrian Risk Awareness. Shubham Jain Look Up! Positioning-based Pedestrian Risk Awareness Shubham Jain Does this look familiar? Pedestrians account for 14% of all traffic fatalities in the US *. In the last decade, 688,000 pedestrians injured

More information

AN UNDERWATER AUGMENTED REALITY SYSTEM FOR COMMERCIAL DIVING OPERATIONS

AN UNDERWATER AUGMENTED REALITY SYSTEM FOR COMMERCIAL DIVING OPERATIONS SYSTEM FOR COMMERCIAL DIVING OPERATIONS ROGELIO!MORALES-GARCÍA, PETER!KEITLER,!PATRICK!MAIER, GUDRUN!KLINKER! FACHGEBIET AUGMENTED (FAR) OCEANS '09 MTS/IEEE BILOXI "MARINE TECHNOLOGY FOR OUR FUTURE: GLOBAL

More information

ZSTT Team Description Paper for Humanoid size League of Robocup 2017

ZSTT Team Description Paper for Humanoid size League of Robocup 2017 Adult- ZSTT Team Description Paper for Humanoid size League of Robocup 2017 Jaesik Jeong, Youngsup Oh and Jeehyun Yang ZSTT E-mail: soulmatree@gmail.com Web: www.soulmatree.com Abstract. This paper describes

More information

NATIONAL INSTRUMENTS AUTONOMOUS ROBOTICS COMPETITION Task and Rules Document

NATIONAL INSTRUMENTS AUTONOMOUS ROBOTICS COMPETITION Task and Rules Document NATIONAL INSTRUMENTS AUTONOMOUS ROBOTICS COMPETITION 2018 2018 Task and Rules Document Table of Contents Competition Background:... 2 Theme: Autonomous Vehicles Fast Track to the Future... 2 Design Elements

More information

IEEE RAS Micro/Nano Robotics & Automation (MNRA) Technical Committee Mobile Microrobotics Challenge 2016

IEEE RAS Micro/Nano Robotics & Automation (MNRA) Technical Committee Mobile Microrobotics Challenge 2016 IEEE RAS Micro/Nano Robotics & Automation (MNRA) Technical Committee Mobile Microrobotics Challenge 2016 OFFICIAL RULES Version 2.0 December 15, 2015 1. THE EVENTS The IEEE Robotics & Automation Society

More information

Your web browser (Safari 7) is out of date. For more security, comfort and. the best experience on this site: Update your browser Ignore

Your web browser (Safari 7) is out of date. For more security, comfort and. the best experience on this site: Update your browser Ignore Your web browser (Safari 7) is out of date. For more security, comfort and Activityengage the best experience on this site: Update your browser Ignore Gearing Up with Robots How are gears used to change

More information

Simulation and mathematical modeling for racket position and attitude of table tennis

Simulation and mathematical modeling for racket position and attitude of table tennis Acta Technica 62 No. 3A/2017, 135 142 c 2017 Institute of Thermomechanics CAS, v.v.i. Simulation and mathematical modeling for racket position and attitude of table tennis Jiansi Song 1 Abstract. Racket

More information

Pedestrian Project List and Prioritization

Pedestrian Project List and Prioritization To: Kyle Wagenschutz, City of Memphis CC: From: Anne Conlon and John Cock, Alta Planning + Design Date: December, 2014 Re: Project List Development (Task 3.1-3.2) and Project List Prioritization (Task

More information

Introducing Probability in RFID Reader-to-Reader Anti-collision

Introducing Probability in RFID Reader-to-Reader Anti-collision 2009 Eighth IEEE International Symposium on Network Computing and Applications Introducing Probability in RFID Reader-to-Reader Anti-collision Filippo Gandino, Renato Ferrero, Bartolomeo Montrucchio, Maurizio

More information

Position Paper on Accessible Roundabouts

Position Paper on Accessible Roundabouts Position Paper on Accessible Roundabouts June 2012 This research based document outlines essential elements in the design of roundabouts, to make them accessible for all pedestrians, including those who

More information

GOLOMB Compression Technique For FPGA Configuration

GOLOMB Compression Technique For FPGA Configuration GOLOMB Compression Technique For FPGA Configuration P.Hema Assistant Professor,EEE Jay Shriram Group Of Institutions ABSTRACT Bit stream compression is important in reconfigurable system design since it

More information

Motion Control of a Bipedal Walking Robot

Motion Control of a Bipedal Walking Robot Motion Control of a Bipedal Walking Robot Lai Wei Ying, Tang Howe Hing, Mohamed bin Hussein Faculty of Mechanical Engineering Universiti Teknologi Malaysia, 81310 UTM Skudai, Johor, Malaysia. Wylai2@live.my

More information

DOI /HORIZONS.B P23 UDC : (497.11) PEDESTRIAN CROSSING BEHAVIOUR AT UNSIGNALIZED CROSSINGS 1

DOI /HORIZONS.B P23 UDC : (497.11) PEDESTRIAN CROSSING BEHAVIOUR AT UNSIGNALIZED CROSSINGS 1 DOI 10.20544/HORIZONS.B.03.1.16.P23 UDC 656.142.054:159.922(497.11) PEDESTRIAN CROSSING BEHAVIOUR AT UNSIGNALIZED CROSSINGS 1 JelenaMitrovićSimić 1, Valentina Basarić, VukBogdanović Department of Traffic

More information

Supplementary Material for Bayes Merging of Multiple Vocabularies for Scalable Image Retrieval

Supplementary Material for Bayes Merging of Multiple Vocabularies for Scalable Image Retrieval Supplementary Material for Bayes Merging of Multiple Vocabularies for Scalable Image Retrieval 1. Overview This document includes supplementary material to Bayes Merging of Multiple Vocabularies for Scalable

More information

A Novel Approach to Predicting the Results of NBA Matches

A Novel Approach to Predicting the Results of NBA Matches A Novel Approach to Predicting the Results of NBA Matches Omid Aryan Stanford University aryano@stanford.edu Ali Reza Sharafat Stanford University sharafat@stanford.edu Abstract The current paper presents

More information

Implementation of Modern Traffic Light Control System

Implementation of Modern Traffic Light Control System International Journal of Scientific and Research Publications, Volume 4, Issue 6, June 2014 1 Implementation of Modern Traffic Light System Nang Hom Kham *, Chaw Myat Nwe ** * Department of Electronic

More information

Road Data Input System using Digital Map in Roadtraffic

Road Data Input System using Digital Map in Roadtraffic Data Input System using Digital Map in traffic Simulation Namekawa,M 1., N.Aoyagi 2, Y.Ueda 2 and A.Satoh 2 1 College of Management and Economics, Kaetsu University, Tokyo, JAPAN 2 Faculty of Engineering,

More information

Global EHS Powered Industrial Truck and Pedestrian Safety

Global EHS Powered Industrial Truck and Pedestrian Safety Global EHS Powered Industrial Truck and Pedestrian Safety Control No: Policy Name: Powered Industrial Truck and Pedestrian Safety Policy Responsible Corporate Function/Business Segment: Global Environmental

More information

Active Travel Strategy Dumfries and Galloway

Active Travel Strategy Dumfries and Galloway Active Travel Strategy Dumfries and Galloway Our Active Travel Strategy The agreed Interventions for Dumfries and Galloway Council s Local Transport Strategy includes an action to Develop an Active Travel

More information

CS 528 Mobile and Ubiquitous Computing Lecture 7a: Applications of Activity Recognition + Machine Learning for Ubiquitous Computing.

CS 528 Mobile and Ubiquitous Computing Lecture 7a: Applications of Activity Recognition + Machine Learning for Ubiquitous Computing. CS 528 Mobile and Ubiquitous Computing Lecture 7a: Applications of Activity Recognition + Machine Learning for Ubiquitous Computing Emmanuel Agu Applications of Activity Recognition Recall: Activity Recognition

More information

LESSON 2: SUBMARINE BUOYANCY INVESTIGATION

LESSON 2: SUBMARINE BUOYANCY INVESTIGATION LESSON 2: SUBMARINE BUOYANCY INVESTIGATION Lesson overview This lesson encourages students to investigate hands-on the property of neutral buoyancy, and to discuss its importance in terms of submarines.

More information

Pedestrian Behaviour Modelling

Pedestrian Behaviour Modelling Pedestrian Behaviour Modelling An Application to Retail Movements using Genetic Algorithm Contents Requirements of pedestrian behaviour models Framework of a new model Test of shortest-path model Urban

More information

COLLISION AVOIDANCE SYSTEM FOR BUSES, MANAGING PEDESTRIAN DETECTION AND ALERTS NEAR BUS STOPS

COLLISION AVOIDANCE SYSTEM FOR BUSES, MANAGING PEDESTRIAN DETECTION AND ALERTS NEAR BUS STOPS COLLISION AVOIDANCE SYSTEM FOR BUSES, MANAGING PEDESTRIAN DETECTION AND ALERTS NEAR BUS STOPS Benjamin Englander Michael Cacic Cheikh Diop Rosco Collision Avoidance, Inc. United States of America Yaniv

More information

Smart Cars for Safe Driving

Smart Cars for Safe Driving Smart Cars for Safe Driving Prof. Dr. Dariu M. Gavrila Environment Perception Group Research and Advanced Engineering XXXII Jornadas de Automática, Sevilla, 9-9-2011 We originally thought Machine Intelligence

More information

Journal of Emerging Trends in Computing and Information Sciences

Journal of Emerging Trends in Computing and Information Sciences A Study on Methods to Calculate the Coefficient of Variance in Daily Traffic According to the Change in Hourly Traffic Volume Jung-Ah Ha Research Specialist, Korea Institute of Construction Technology,

More information

Ranger Walking Initiation Stephanie Schneider 5/15/2012 Final Report for Cornell Ranger Research

Ranger Walking Initiation Stephanie Schneider 5/15/2012 Final Report for Cornell Ranger Research 1 Ranger Walking Initiation Stephanie Schneider sns74@cornell.edu 5/15/2012 Final Report for Cornell Ranger Research Abstract I joined the Biorobotics Lab this semester to gain experience with an application

More information

Introducing STAMP in Road Tunnel Safety

Introducing STAMP in Road Tunnel Safety Introducing STAMP in Road Tunnel Safety Kostis Kazaras National Technical University of Athens, Mechanical Engineering School, Greece Contact details: kkazaras@gmail.com kkaz@central.ntua.gr Problem illustration

More information

AUTONOMOUS AND AUTOMATIC ACCIDENT RECOVERY SYSTEM USING GPS AND HAM RADIO

AUTONOMOUS AND AUTOMATIC ACCIDENT RECOVERY SYSTEM USING GPS AND HAM RADIO AUTONOMOUS AND AUTOMATIC ACCIDENT RECOVERY SYSTEM USING GPS AND HAM RADIO 1 Sidhartha Velpula, student, ECE Department, KL University, India, velpulasidhartha@gmail.com 2 Vivek Obilineni, student, ECE

More information

Optimum distance for voice navigation in walking support system for visually impaired

Optimum distance for voice navigation in walking support system for visually impaired Optimum distance for voice navigation in walking support system for visually impaired Akinari Ohfuji 1, Yoshihiro Taniura 2, Dai Hanawa 1,3 1, 2,a and Kimio Oguchi 1 Information Networking Laboratory,

More information

Generation of See-Through Baseball Movie from Multi-Camera Views

Generation of See-Through Baseball Movie from Multi-Camera Views Generation of See-Through Baseball Movie from Multi-Camera Views Takanori Hashimoto #1, Yuko Uematsu #2, Hideo Saito #3 # Keio University 3-14-1 Hiyoshi, Kohoku-ku, Yokohama, 223-8522 Japan 1 takanori@hvrl.ics.keio.ac.jp

More information

A climbing motion recognition method using anatomical information for screen climbing games

A climbing motion recognition method using anatomical information for screen climbing games DOI 10.1186/s13673-017-0106-5 RESEARCH Open Access A climbing motion recognition method using anatomical information for screen climbing games Jungsoo Kim 1, Daniel Chung 2 and Ilju Ko 2* *Correspondence:

More information

MA PM: Memetic algorithms with population management

MA PM: Memetic algorithms with population management MA PM: Memetic algorithms with population management Kenneth Sörensen University of Antwerp kenneth.sorensen@ua.ac.be Marc Sevaux University of Valenciennes marc.sevaux@univ-valenciennes.fr August 2004

More information

Automated Proactive Road Safety Analysis

Automated Proactive Road Safety Analysis Transportation Research At McGill Seminar Nicolas Saunier nicolas.saunier@polymtl.ca November 25 th 2010 Outline 1 2 for 3 using Video Data 4 Using Microscopic Data 5 A World Health Issue Over 1.2 million

More information

Evaluating the Influence of R3 Treatments on Fishing License Sales in Pennsylvania

Evaluating the Influence of R3 Treatments on Fishing License Sales in Pennsylvania Evaluating the Influence of R3 Treatments on Fishing License Sales in Pennsylvania Prepared for the: Pennsylvania Fish and Boat Commission Produced by: PO Box 6435 Fernandina Beach, FL 32035 Tel (904)

More information

Active Pedestrian Safety: from Research to Reality

Active Pedestrian Safety: from Research to Reality Active Pedestrian Safety: from Research to Reality Dariu M. Gavrila Environment Perception Research and Development Oxford University, 04-10-2013 We originally thought Machine Intelligence would look like

More information

Aalborg Universitet. Publication date: Document Version Accepted author manuscript, peer reviewed version

Aalborg Universitet. Publication date: Document Version Accepted author manuscript, peer reviewed version Aalborg Universitet Automatic Detection Of Conflicts At Signalized Intersections Madsen, Tanja Kidholm Osmann; Bahnsen, Chris Holmberg; Lahrmann, Harry Spaabæk; Moeslund, Thomas B. Publication date: 2014

More information

National Robotics Competition 2018 NRC WRO Challenge Manual

National Robotics Competition 2018 NRC WRO Challenge Manual National Robotics Competition 2018 NRC WRO Challenge Manual Page 1 of 13 A. Competition Categories World Robot Olympiad has three regular competition categories, and an Open category: 1. Regular Category

More information

Figure 1. Results of the Application of Blob Entering Detection Techniques.

Figure 1. Results of the Application of Blob Entering Detection Techniques. Thailand Ranks Second in the World for Number of Road Accidents under Thailand's Codes of Geometrical Design and Traffic Engineering Concept When Compared with AASHTO Weeradej Cheewapattananuwong Bureau

More information

World Leading Traffic Analysis

World Leading Traffic Analysis World Leading Traffic Analysis Over the past 25 years, has worked closely with road authorities and traffic managers around the world to deliver leading traffic monitoring equipment. With products now

More information

2012 NRC - RULES AND REGULATIONS

2012 NRC - RULES AND REGULATIONS 2012 NRC - RULES AND REGULATIONS General Guidelines 1. A school team should comprise of 2 or 3 students and one teacher. 2. Each school can send a maximum of 5 teams for each category. 3. All rules and

More information

BHATNAGAR. Reducing Delay in V2V-AEB System by Optimizing Messages in the System

BHATNAGAR. Reducing Delay in V2V-AEB System by Optimizing Messages in the System Reducing Delay in V2V-AEB System by Optimizing Messages in the System Shalabh Bhatanagar Stanley Chien Yaobin Chen TASI, IUPUI, Indianapolis USA Paper Number: 17-0330 ABSTRACT In V2V-AEB (Vehicle to Vehicle

More information

The problem is not automation, the problem is communication: Autonomy, human factors and safety in the maritime domain

The problem is not automation, the problem is communication: Autonomy, human factors and safety in the maritime domain The problem is not automation, the problem is communication: Autonomy, human factors and safety in the maritime domain Monitoring Navigator Navigating Automation Thomas Porathe Professor, Interaction Design

More information

Outline. TAMU Campus Projects TxDOT Innovative Research Project Mobileye Shield+ Pilot

Outline. TAMU Campus Projects TxDOT Innovative Research Project Mobileye Shield+ Pilot Outline TAMU Campus Projects TxDOT Innovative Research Project Mobileye Shield+ Pilot How Does Initiative Work? Campus Transportation Technology Initiative Solicit technology demonstrations via RFI process

More information

Lecture 1 Temporal constraints: source and characterization

Lecture 1 Temporal constraints: source and characterization Real-Time Systems Lecture 1 Temporal constraints: source and characterization Basic concepts about real-time Requirements of Real-Time Systems Adapted from the slides developed by Prof. Luís Almeida for

More information

A comprehensive evaluation of the methods for evolving a cooperative team

A comprehensive evaluation of the methods for evolving a cooperative team Artif Life Robotics (2006) 10:157 161 ISAROB 2006 DOI 10.1007/s10015-005-0354-8 ORIGINAL ARTICLE Yasuyuki Suzuki Takaya Arita A comprehensive evaluation of the methods for evolving a cooperative team Received

More information

EUROPEAN COMMISSION DG RTD. evader

EUROPEAN COMMISSION DG RTD. evader EUROPEAN COMMISSION DG RTD SEVENTH FRAMEWORK PROGRAMME THEME 7 TRANSPORT - SST SST.2011.RTD-1 GA No. 285095 evader Electric Vehicle Alert for Detection and Emergency Response Deliverable No. D2.0 Document

More information

Synthesis of Safety For Traffic Operations. Leanna Belluz Transport Canada. Gerry Forbes, M.Eng., P.Eng., P.T.O.E. Intus Road Safety Engineering Inc.

Synthesis of Safety For Traffic Operations. Leanna Belluz Transport Canada. Gerry Forbes, M.Eng., P.Eng., P.T.O.E. Intus Road Safety Engineering Inc. Synthesis of Safety For Traffic Operations Leanna Belluz Transport Canada Gerry Forbes, M.Eng., P.Eng., P.T.O.E. Intus Road Safety Engineering Inc. Paper prepared for presentation at the Traffic Operations

More information

Special Provisions for Left Turns at Signalized Intersections to Increase Capacity and Safety

Special Provisions for Left Turns at Signalized Intersections to Increase Capacity and Safety Journal of Advanced Transportation, Vol. 31, No. 1, pp, 95-109 Special Provisions for Left Turns at Signalized Intersections to Increase Capacity and Safety Bu-Yong Shin Heavy left-turns at intersections

More information

Replay using Recomposition: Alignment-Based Conformance Checking in the Large

Replay using Recomposition: Alignment-Based Conformance Checking in the Large Replay using Recomposition: Alignment-Based Conformance Checking in the Large Wai Lam Jonathan Lee 2, H.M.W. Verbeek 1, Jorge Munoz-Gama 2, Wil M.P. van der Aalst 1, and Marcos Sepúlveda 2 1 Architecture

More information

Fail Operational Controls for an Independent Metering Valve

Fail Operational Controls for an Independent Metering Valve Group 14 - System Intergration and Safety Paper 14-3 465 Fail Operational Controls for an Independent Metering Valve Michael Rannow Eaton Corporation, 7945 Wallace Rd., Eden Prairie, MN, 55347, email:

More information

COACH PROGRAM The First Tee Master Coach

COACH PROGRAM The First Tee Master Coach COACH PROGRAM The First Tee Master Coach [2015/16 Edition] 2014 World Golf Foundation, Inc. All rights reserved. Use with permission. THE FIRST TEE MASTER COACH TABLE OF CONTENTS THE FIRST TEE MASTER COACH

More information