Video Analytics for Railroad Safety Research: An Artificial Intelligence Approach

Asim Zaman, Xiang Liu, Zhipeng Zhang

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The volume of video data in the railroad industry has increased significantly in recent years. Surveillance cameras are situated on nearly every part of the railroad system, such as inside the cab, along the track, at grade crossings, and in stations. These camera systems are manually monitored, either live or subsequently reviewed in an archive, which requires an immense amount of human resources. To make the video analysis much less labor-intensive, this paper develops a framework for utilizing artificial intelligence (AI) technologies for the extraction of useful information from these big video datasets. This framework has been implemented based on the video data from one grade crossing in New Jersey. The AI algorithm can automatically detect unsafe trespassing of railroad tracks (called near-miss events in this paper). To date, the AI algorithm has analyzed hours of video data and correctly detected all near-misses. This pilot study indicates the promise of using AI for automated analysis of railroad video big data, thereby supporting data-driven railroad safety research. For practical use, our AI algorithm has been packaged into a computer-aided decision support tool (named AI-Grade) that outputs near-miss video clips based on user-provided raw video data. This paper and its sequent studies aim to provide the railroad industry with next-generation big data analysis methods and tools for quickly and reliably processing large volumes of video data in order to better understand human factors in railroad safety research.

Original languageEnglish (US)
Pages (from-to)269-277
Number of pages9
JournalTransportation Research Record
Volume2672
Issue number10
DOIs
StatePublished - Dec 1 2018

Fingerprint

Railroads
Artificial intelligence
Cameras
Personnel
Railroad tracks
Human engineering
Industry
Processing

All Science Journal Classification (ASJC) codes

  • Civil and Structural Engineering
  • Mechanical Engineering

Cite this

@article{b36ee839bb8e4248a996eec5ca4c42bc,
title = "Video Analytics for Railroad Safety Research: An Artificial Intelligence Approach",
abstract = "The volume of video data in the railroad industry has increased significantly in recent years. Surveillance cameras are situated on nearly every part of the railroad system, such as inside the cab, along the track, at grade crossings, and in stations. These camera systems are manually monitored, either live or subsequently reviewed in an archive, which requires an immense amount of human resources. To make the video analysis much less labor-intensive, this paper develops a framework for utilizing artificial intelligence (AI) technologies for the extraction of useful information from these big video datasets. This framework has been implemented based on the video data from one grade crossing in New Jersey. The AI algorithm can automatically detect unsafe trespassing of railroad tracks (called near-miss events in this paper). To date, the AI algorithm has analyzed hours of video data and correctly detected all near-misses. This pilot study indicates the promise of using AI for automated analysis of railroad video big data, thereby supporting data-driven railroad safety research. For practical use, our AI algorithm has been packaged into a computer-aided decision support tool (named AI-Grade) that outputs near-miss video clips based on user-provided raw video data. This paper and its sequent studies aim to provide the railroad industry with next-generation big data analysis methods and tools for quickly and reliably processing large volumes of video data in order to better understand human factors in railroad safety research.",
author = "Asim Zaman and Xiang Liu and Zhipeng Zhang",
year = "2018",
month = "12",
day = "1",
doi = "10.1177/0361198118792751",
language = "English (US)",
volume = "2672",
pages = "269--277",
journal = "Transportation Research Record",
issn = "0361-1981",
publisher = "US National Research Council",
number = "10",

}

Video Analytics for Railroad Safety Research : An Artificial Intelligence Approach. / Zaman, Asim; Liu, Xiang; Zhang, Zhipeng.

In: Transportation Research Record, Vol. 2672, No. 10, 01.12.2018, p. 269-277.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Video Analytics for Railroad Safety Research

T2 - An Artificial Intelligence Approach

AU - Zaman, Asim

AU - Liu, Xiang

AU - Zhang, Zhipeng

PY - 2018/12/1

Y1 - 2018/12/1

N2 - The volume of video data in the railroad industry has increased significantly in recent years. Surveillance cameras are situated on nearly every part of the railroad system, such as inside the cab, along the track, at grade crossings, and in stations. These camera systems are manually monitored, either live or subsequently reviewed in an archive, which requires an immense amount of human resources. To make the video analysis much less labor-intensive, this paper develops a framework for utilizing artificial intelligence (AI) technologies for the extraction of useful information from these big video datasets. This framework has been implemented based on the video data from one grade crossing in New Jersey. The AI algorithm can automatically detect unsafe trespassing of railroad tracks (called near-miss events in this paper). To date, the AI algorithm has analyzed hours of video data and correctly detected all near-misses. This pilot study indicates the promise of using AI for automated analysis of railroad video big data, thereby supporting data-driven railroad safety research. For practical use, our AI algorithm has been packaged into a computer-aided decision support tool (named AI-Grade) that outputs near-miss video clips based on user-provided raw video data. This paper and its sequent studies aim to provide the railroad industry with next-generation big data analysis methods and tools for quickly and reliably processing large volumes of video data in order to better understand human factors in railroad safety research.

AB - The volume of video data in the railroad industry has increased significantly in recent years. Surveillance cameras are situated on nearly every part of the railroad system, such as inside the cab, along the track, at grade crossings, and in stations. These camera systems are manually monitored, either live or subsequently reviewed in an archive, which requires an immense amount of human resources. To make the video analysis much less labor-intensive, this paper develops a framework for utilizing artificial intelligence (AI) technologies for the extraction of useful information from these big video datasets. This framework has been implemented based on the video data from one grade crossing in New Jersey. The AI algorithm can automatically detect unsafe trespassing of railroad tracks (called near-miss events in this paper). To date, the AI algorithm has analyzed hours of video data and correctly detected all near-misses. This pilot study indicates the promise of using AI for automated analysis of railroad video big data, thereby supporting data-driven railroad safety research. For practical use, our AI algorithm has been packaged into a computer-aided decision support tool (named AI-Grade) that outputs near-miss video clips based on user-provided raw video data. This paper and its sequent studies aim to provide the railroad industry with next-generation big data analysis methods and tools for quickly and reliably processing large volumes of video data in order to better understand human factors in railroad safety research.

UR - http://www.scopus.com/inward/record.url?scp=85052561664&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85052561664&partnerID=8YFLogxK

U2 - 10.1177/0361198118792751

DO - 10.1177/0361198118792751

M3 - Article

AN - SCOPUS:85052561664

VL - 2672

SP - 269

EP - 277

JO - Transportation Research Record

JF - Transportation Research Record

SN - 0361-1981

IS - 10

ER -