integrate-road-network
π―Skillfrom dudusoar/vrp-toolkit
Extracts and integrates real-world street networks from OpenStreetMap for Vehicle Routing Problem (VRP) modeling and analysis.
Installation
npx skills add https://github.com/dudusoar/vrp-toolkit --skill integrate-road-networkSkill Details
Integrate real-world street networks into VRP problems using OpenStreetMap data. Use when loading real map data, creating instances from actual locations, computing network-based distances, or building tutorials with real-world scenarios. Guides through installation, loading areas, extracting nodes, computing distance matrices, and creating PDPTW instances from map data.
Overview
# Road Network Integration
Integrate real-world street networks from OpenStreetMap into your VRP toolkit using map data.
Integration Workflow
Step 1: Install Dependencies
Install OSMnx and geo-processing libraries.
Using conda (recommended):
```bash
conda install -c conda-forge osmnx
```
Using pip:
```bash
pip install osmnx geopandas shapely fiona pyproj
```
Verify installation:
```python
import osmnx as ox
print(f"OSMnx version: {ox.__version__}")
```
Troubleshooting: See [troubleshooting.md](references/troubleshooting.md) for installation issues.
Step 2: Load Street Network
Choose loading method based on your needs:
#### Option A: Load by Place Name
For well-known locations (recommended for campuses, cities).
```python
import osmnx as ox
# Load area by name
place_name = "Purdue University, West Lafayette, IN, USA"
G = ox.graph_from_place(
place_name,
network_type='drive', # 'drive', 'walk', 'bike', or 'all'
simplify=True
)
# Save for reuse (much faster than re-downloading)
ox.save_graphml(G, "data/campus_network.graphml")
print(f"Loaded {len(G.nodes)} nodes and {len(G.edges)} edges")
```
#### Option B: Load by Bounding Box
For specific coordinate ranges.
```python
# Define bounding box (north, south, east, west)
north, south, east, west = 40.4300, 40.4200, -86.9100, -86.9250
G = ox.graph_from_bbox(north, south, east, west, network_type='drive')
```
Data structure details: See [maintain-data-structures](../maintain-data-structures/) skill β data_layer.md β OSMnx Graph
More examples: See [osmnx_examples.md](references/osmnx_examples.md) β Examples 1-2
Step 3: Define VRP Locations
Map your problem locations (depot, customers, pickups, deliveries) to network nodes.
#### 3a. Extract from Points of Interest (POIs)
```python
# Find buildings/amenities as potential locations
tags = {
'building': ['university', 'dormitory'],
'amenity': ['cafe', 'restaurant', 'library']
}
pois = ox.geometries_from_place(place_name, tags=tags)
# Extract coordinates
locations = []
for idx, poi in pois.iterrows():
if poi.geometry.geom_type == 'Point':
lat, lon = poi.geometry.y, poi.geometry.x
else: # Polygon
lat, lon = poi.geometry.centroid.y, poi.geometry.centroid.x
locations.append((lat, lon))
print(f"Found {len(locations)} potential customer locations")
```
#### 3b. Use Manually Defined Locations
```python
# Define locations manually (lat, lon)
depot_loc = (40.4237, -86.9212)
pickup_locs = [
(40.4280, -86.9145),
(40.4200, -86.9180)
]
delivery_locs = [
(40.4250, -86.9100),
(40.4210, -86.9220)
]
```
More examples: See [osmnx_examples.md](references/osmnx_examples.md) β Example 3
Step 4: Map to Network Nodes
Find nearest nodes in the street network for each location.
```python
# Find nearest network nodes
depot_node = ox.distance.nearest_nodes(
G,
depot_loc[1], # X = longitude
depot_loc[0] # Y = latitude
)
pickup_nodes = [
ox.distance.nearest_nodes(G, lon, lat)
for lat, lon in pickup_locs
]
delivery_nodes = [
ox.distance.nearest_nodes(G, lon, lat)
for lat, lon in delivery_locs
]
# All nodes for VRP instance
all_osm_nodes = [depot_node] + pickup_nodes + delivery_nodes
print(f"Mapped to {len(all_osm_nodes)} network nodes")
```
IMPORTANT: nearest_nodes takes (X, Y) which is (longitude, latitude), NOT (lat, lon)!
Troubleshooting: See [troubleshooting.md](references/troubleshooting.md) β Coordinate Issues
More examples: See [osmnx_examples.md](references/osmnx_examples.md) β Example 4
Step 5: Compute Distance Matrix
Calculate network-based distances between all nodes.
```python
import networkx as nx
import numpy as np
n = len(all_osm_nodes)
distance_matrix = np.zeros((n, n))
for i, origin in enumerate(all_osm_nodes):
# Compute shortest paths from origin to all destinations
lengths = nx.single_source_dijkstra_path_length(
G, origin, weight='length' # Use 'length' for distance in meters
)
for j, dest in enumerate(all_osm_nodes):
if i != j and dest in lengths:
distance_matrix[i, j] = lengths[dest]
print("Distance matrix computed (in meters)")
print(distance_matrix)
```
Optional: Convert to time matrix
```python
average_speed_kmh = 30 # km/h
average_speed_ms = average_speed_kmh * 1000 / 3600 # m/s
time_matrix_seconds = distance_matrix / average_speed_ms
time_matrix_minutes = time_matrix_seconds / 60
```
Data structure details: See [maintain-data-structures](../maintain-data-structures/) skill β runtime_formats.md β Distance Matrix
Troubleshooting: See [troubleshooting.md](references/troubleshooting.md) β Routing Issues
More examples: See [osmnx_examples.md](references/osmnx_examples.md) β Examples 5-6
Step 6: Create Node Objects
Create VRP toolkit Node objects from OSMnx nodes.
```python
from vrp_toolkit.problems import Node
nodes = []
# Depot
depot_data = G.nodes[depot_node]
nodes.append(Node(
node_id=0,
x=depot_data['x'], # longitude
y=depot_data['y'], # latitude
node_type='depot'
))
# Pickups and deliveries (paired)
for idx, (p_node, d_node) in enumerate(zip(pickup_nodes, delivery_nodes), 1):
pickup_id = idx * 2 - 1
delivery_id = idx * 2
# Pickup node
p_data = G.nodes[p_node]
nodes.append(Node(
node_id=pickup_id,
x=p_data['x'],
y=p_data['y'],
demand=10.0, # Adjust as needed
time_window=(8.0, 17.0), # 8am - 5pm
service_time=0.25, # 15 minutes
node_type='pickup',
pair_node_id=delivery_id
))
# Delivery node
d_data = G.nodes[d_node]
nodes.append(Node(
node_id=delivery_id,
x=d_data['x'],
y=d_data['y'],
demand=-10.0, # Negative for delivery
time_window=(8.0, 17.0),
service_time=0.25,
node_type='delivery',
pair_node_id=pickup_id
))
print(f"Created {len(nodes)} Node objects")
```
Data structure details: See [maintain-data-structures](../maintain-data-structures/) skill β problem_layer.md β Node
Step 7: Create PDPTW Instance
Combine everything into a problem instance.
```python
from vrp_toolkit.problems import PDPTWInstance
instance = PDPTWInstance(
nodes=nodes,
battery_capacity=100.0,
max_route_time=480.0, # 8 hours in minutes
vehicle_capacity=50.0
)
# Attach distance matrix
instance.distance_matrix = distance_matrix
# Optionally attach time matrix
instance.time_matrix = time_matrix_minutes
# Save instance for later use
import pickle
with open('data/campus_pdptw_instance.pkl', 'wb') as f:
pickle.dump(instance, f)
print("PDPTW instance created successfully!")
```
Complete example: See [osmnx_examples.md](references/osmnx_examples.md) β Example 7
Data structure details: See [maintain-data-structures](../maintain-data-structures/) skill β problem_layer.md β PDPTWInstance
Step 8: Validate and Solve
Test the instance and solve.
```python
from vrp_toolkit.algorithms.alns import ALNSSolver, ALNSConfig
# Validate instance
print(f"Number of nodes: {len(instance.nodes)}")
print(f"Number of pickup-delivery pairs: {len(instance.pickup_delivery_pairs)}")
print(f"Distance matrix shape: {instance.distance_matrix.shape}")
# Solve
config = ALNSConfig(max_iterations=1000)
solver = ALNSSolver(config)
solution = solver.solve(instance)
# Check solution
if solution.is_feasible():
print(f"Feasible solution found!")
print(f"Objective value: {solution.objective_value()}")
solution.plot()
else:
print("Solution is infeasible")
```
Advanced Features
Visualize Routes on Street Network
Plot solution routes on the actual map.
```python
import matplotlib.pyplot as plt
# Plot base network
fig, ax = ox.plot_graph(
G,
bgcolor='white',
node_size=0,
edge_color='gray',
edge_linewidth=0.5,
show=False,
close=False
)
# Plot solution routes (assuming routes contain OSM node IDs)
colors = ['blue', 'red', 'green', 'orange']
for route_idx, route in enumerate(solution.routes):
# Map VRP node IDs back to OSM node IDs
osm_route = [all_osm_nodes[node_id] for node_id in route]
# Get coordinates
xs = [G.nodes[node]['x'] for node in osm_route]
ys = [G.nodes[node]['y'] for node in osm_route]
# Plot
ax.plot(xs, ys,
color=colors[route_idx % len(colors)],
linewidth=3,
alpha=0.7,
label=f'Route {route_idx + 1}')
ax.legend()
plt.title("VRP Solution on Real Street Network")
plt.show()
```
More examples: See [osmnx_examples.md](references/osmnx_examples.md) β Example 8
Cache for Performance
Save processed graphs to avoid re-downloading.
```python
import os
cache_file = "data/campus_network.graphml"
if os.path.exists(cache_file):
# Load from cache (instant!)
G = ox.load_graphml(cache_file)
print("Loaded from cache")
else:
# Download and save
G = ox.graph_from_place(place_name)
ox.save_graphml(G, cache_file)
print("Downloaded and cached")
```
More examples: See [osmnx_examples.md](references/osmnx_examples.md) β Example 9
Handle Graph Connectivity
Ensure all nodes can reach each other.
```python
import networkx as nx
# Check connectivity
if not nx.is_weakly_connected(G):
print("Graph has multiple disconnected components")
# Keep only largest connected component
largest_component = max(
nx.weakly_connected_components(G),
key=len
)
G = G.subgraph(largest_component).copy()
print(f"Using largest component with {len(G.nodes)} nodes")
```
Troubleshooting: See [troubleshooting.md](references/troubleshooting.md) β Routing Issues
Creating Tutorials with OSMnx
When creating a tutorial that uses OSMnx:
- Choose recognizable location
- Use well-known places (e.g., university campus, downtown area)
- Easier for readers to relate to
- Cache the graph
- Include downloaded graph in tutorial repository
- Avoids download delays for users
- Use small areas
- Keep examples fast (<30 seconds to run)
- Small bounding boxes or specific places
- Provide visualization
- Plot the network with routes overlaid
- Makes results more tangible
- Handle edge cases
- Show what to do if node unreachable
- Demonstrate connectivity checks
Common Patterns
Pattern 1: Campus Routing
```python
# 1. Load campus
G = ox.graph_from_place("University Name, City, State, USA")
# 2. Find buildings as customer locations
pois = ox.geometries_from_place(place_name, tags={'building': True})
# 3. Create distance matrix
# 4. Build PDPTW instance
# 5. Solve and visualize on map
```
Pattern 2: City-Wide Delivery
```python
# 1. Load city with bounding box
G = ox.graph_from_bbox(north, south, east, west)
# 2. Use address geocoding for customer locations
# 3. Compute network distances
# 4. Create VRP instance
# 5. Solve at scale
```
Pattern 3: Benchmark Comparison
```python
# Create two instances:
# - Euclidean distance (traditional)
# - Network distance (OSMnx)
# Compare solution quality and computation time
```
Integration with Other Skills
Works with:
- maintain-data-structures: Reference OSMnx data structures (Graph, GeoDataFrame, distance matrices)
- migrate-module: When migrating
real_map.pyfrom old codebase - tutorial-creator: When creating real-world VRP tutorials (when that skill exists)
Example:
```
You: "Create a real-world PDPTW instance for Purdue campus"
β osmnx-integration skill triggers
β References maintain-data-structures for OSMnx Graph structure
β Creates instance following workflow
```
Reference Materials
- Examples: [osmnx_examples.md](references/osmnx_examples.md) - 10 complete examples
- Troubleshooting: [troubleshooting.md](references/troubleshooting.md) - Common issues and solutions
- Data Structures: See [maintain-data-structures](../maintain-data-structures/) skill for OSMnx structure details
Key Reminders
- β οΈ Coordinate order:
nearest_nodes(G, lon, lat)not(lat, lon)! - πΎ Cache graphs: Save downloaded graphs to avoid re-downloading
- π Check connectivity: Ensure all nodes can reach each other
- π Distance units: OSMnx uses meters, convert as needed
- πΊοΈ Simplify graphs: Use
simplify=Truefor faster processing unless you need exact geometry
More from this repository10
Generates structured, informative git commit messages following Conventional Commits format for consistent project documentation.
Migrates Python research modules from SDR_stochastic to vrp-toolkit, refactoring code into generic, reusable implementations across problem, algorithm, and data layers.
Maintains a comprehensive, up-to-date architecture map documenting system modules, data flows, entry points, and dependencies in ARCHITECTURE_MAP.md.
create-playground skill from dudusoar/vrp-toolkit
Synchronizes TASK_BOARD.md by reading project logs and updating task statuses to reflect actual progress.
Quickly manages Python virtual environments, packages, and dependencies using uv, providing fast and modern project setup commands.
update-migration-log skill from dudusoar/vrp-toolkit
Systematically maps Streamlit playground UI to vrp-toolkit backend APIs, providing interface references and contract test integration for efficient module connections.
Logs and tracks development issues, debugging processes, and solutions in a structured DEBUG_LOG.md file for systematic problem resolution and knowledge retention.
Manages and maintains VRP Toolkit skills through compliance checks, documentation sync, and change tracking.