MACRO SCALE · NYSDOT I-95 & NYC DOT · 61.9 HOURS

Continuous Highway 3D LiDAR + RGB Synchronization & Evaluation

Models trained on sunny 20-second ego-vehicle clips break down on multi-lane highways when clocks drift by tens of milliseconds or sparse far-range sweeps hit 6-lane traffic. We engineered an end-to-end synchronized capture, calibration, and sparse-to-dense 3D perception pipeline validated across 61.9 hours (743 raw sessions) and live NYSDOT I-95 deployments.

61.9 Hours · 743 Raw Sessions 90.1% vs. 72.9% on I-95 IEEE OJ-ITS 2026 MobiSPC 2025 (2 Papers)
NYSDOT Interstate 95 Bronx roadside LiDAR and RGB camera highway deployment
NYSDOT I-95 CORRIDOR DEPLOYMENT · BRONX, NY CLICK IMAGE TO ENLARGE
90.1% Fixed-Sensor Crossing Recovery Outperforms ego-centric 3D detector baseline (72.9%) on I-95
61.9 Hours InfraLiDAR-Eval Benchmark 743 continuous raw recording sessions across urban & highway sites
6 Stages Synchronized 2D–3D Loop Clock drift correction → extrinsic fusion → multi-sweep stitching
Zero-Rewrite Cross-Site Portability Adapts across beam counts, mast heights, and camera frame rates

WHY SYNCHRONIZATION IS THE HARD PART

Sub-Frame Temporal & Spatial Alignment at Highway Speeds

At 65 mph (29 m/s), a 50 ms clock offset between a spinning 3D LiDAR and an RGB camera shifts projected bounding boxes by 1.45 meters — smearing multi-frame point-cloud reconstruction and collapsing downstream VRU/freight classification.

3D LIDAR SWEEPS 10–20 Hz packet stream PTP / host drift tracking RGB CAMERA STREAM 30 FPS high-res optics Intrinsics + lens undistort TEMPORAL + EXTRINSIC LOCK Clock Drift + 6-DoF T_cam←lidar Eliminates 29 m/s highway projection lag STATIC BG REMOVAL + 3D CNN Fixed-Perspective Prior Cars · Trucks · Bikes · Pedestrians SPARSE → DENSE 3D Multi-Sweep Stitch 90.1% I-95 Recovery FHWA Axle/Class Ready
STAGE 01

Multi-Sensor Ingestion

Continuous capture of raw 3D LiDAR UDP sweeps and high-resolution RGB streams across 743 unattended field sessions.

STAGE 02

Temporal Drift Correction

Timestamp alignment and online clock-skew compensation between LiDAR hardware timestamps and camera exposure triggers.

STAGE 03

6-DoF Extrinsic Calibration

Rigid spatial calibration mapping 3D point clouds onto RGB image planes across varying mast heights and tilt geometries.

STAGE 04

Background Modeling

Exploiting stationary roadside geometry to strip guardrails, overpasses, and foliage before 3D proposal generation.

STAGE 05

CNN 3D VRU & Freight Detection

Config-portable 3D detection classifying passenger cars, multi-unit freight trucks, motorcycles, cyclists, and pedestrians.

STAGE 06

Multi-Frame Vehicle Stitching

Rigid-body registration accumulating sparse distant LiDAR returns across consecutive sweeps into dense per-vehicle 3D models.

NYSDOT I-95 BENCHMARK · INFRALIDAR-EVAL

90.1% Fixed-Sensor Crossing Recovery vs. 72.9% Ego Baseline

Off-the-shelf 3D detectors trained on ego-vehicle datasets (KITTI, Waymo, nuScenes) assume a sensor moving at bumper/roof height (~1.8 m). Mounted on an elevated roadside mast overlooking Interstate 95 in the Bronx, those ego-centric models drop to 72.9% vehicle crossing recovery due to pitch/height domain shift and far-lane sparsity.

  • Fixed-Geometry Conditioning (90.1%): Incorporating stationary background priors, ground-plane rectification, and temporal track continuity recovers +17.2 percentage points on live highway traffic.
  • 61.9-Hour Failure Taxonomy: Documents sensor thermal drift, rain/spray backscatter, heavy-truck shadow handoffs, and beam-count sensitivity across 743 sessions.
NYSDOT I-95 vehicle crossing recovery benchmark comparing 90.1% fixed-sensor pipeline against 72.9% ego-centric detector
NYSDOT I-95 benchmark: 90.1% crossing recovery with fixed-sensor conditioning vs. 72.9% ego-centric detector.
Synchronized roadside LiDAR and RGB vehicle crops from the 61.9-hour InfraLiDAR-Eval dataset
Synchronized 2D–3D roadside instances across lighting, weather, and occlusion regimes in InfraLiDAR-Eval.

FINE-GRAINED FREIGHT & ZERO-INFRASTRUCTURE SCALING

From Dense 3D Truck Profiles to Citywide Curbside Freight Sensing

Multi-sweep point-cloud registration unlocks fine-grained geometric classification of commercial vehicles (box trucks, articulated tractor-trailers, tankers) directly from roadside LiDAR — and pairs with citywide Street View imagery (IEEE OJ-ITS 2026) and VLM-guided traffic curation to map freight demand before permanent sensors are installed.

Multi-frame 3D point cloud reconstructions of commercial truck classes from roadside LiDAR
Multi-sweep 3D vehicle point-cloud reconstructions enabling geometry-based commercial freight classification.

PUBLICATIONS & AGENCY COLLABORATIONS

Published Corridor & Freight Sensing Work

IEEE Open Journal of Intelligent Transportation Systems · 2026

Citywide Urban Freight & Truck Activity Estimation from Street-Level Imagery

Complements fixed corridor LiDAR with scalable spatial freight demand mapping across urban road networks.

MobiSPC · 2025 (Two Papers) & InfraLiDAR-Eval

Roadside Sensing Perspectives & LiDAR Beam-Count Study for VRU Detection

Field-deployed synchronization and 3D perception pipeline supporting NYSDOT and NYC DOT collaborations.