Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ultra Fast Lane Detection_v2 model ttnn bring up #18749

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 39 additions & 0 deletions models/experimental/functional_UFLD_v2/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
# Ultra-Fast-Lane-Detection-v2

### Platforms:
WH N300

### Introduction

The Ultra-Fast-Lane-Detection-v2 is a PyTorch-based implementation designed for fast and efficient deep lane detection using hybrid anchor-driven ordinal classification. It enhances the speed and accuracy of lane detection models with a focus on real-time applications.

Resource link - [source](https://github.com/cfzd/Ultra-Fast-Lane-Detection-v2)

Dataset Link - [source](https://github.com/TuSimple/tusimple-benchmark/issues/3), [kaggle](https://www.kaggle.com/datasets/manideep1108/tusimple?resource=download)


The repository includes models trained on various datasets such as [CULane](https://github.com/cfzd/Ultra-Fast-Lane-Detection-v2/blob/master/model/model_culane.py), [CurveLanes](https://github.com/cfzd/Ultra-Fast-Lane-Detection-v2/blob/master/model/model_curvelanes.py), and [Tusimple](https://github.com/cfzd/Ultra-Fast-Lane-Detection-v2/blob/master/model/model_tusimple.py)



### Model Details

- The entry point to the UFLD_v2 is located at:`models/experimental/functional_UFLD_v2/ttnn/ttnn_UFLD_v2.py`
- The model picks up trained weights from the **tusimple_res34.pth** file located at:`models/experimental/functional_UFLD_v2/reference/tusimple_res34.pth`
- Batch Size :2

### UFLD_v2 Demo

- This demo setup runs with 30 images taken from [Tu_Simple]((https://www.kaggle.com/datasets/manideep1108/tusimple?resource=download)) Dataset with input resolution of (320 x 800)
- Command to Run Demo: `pytest --disable-warnings models/experimental/functional_UFLD_v2/demo/demo.py`
- This setup takes images from this folder(`models/experimental/functional_UFLD_v2/demo/images`) and validates the model results with Ground_table values stored here(`models/experimental/functional_UFLD_v2/demo/GT_test_labels.json`) with F1 score as Output Metric.
- To test the model on different input data, simply add new image files to this images directory and gt values to json.
- The output results for both torch and ttnn model will be stored in this directory(.txt files). - `models/experimental/functional_UFLD_v2/demo/results_txt`

#### Note: The post-processing is performed using PyTorch.


- Use the following command to run the UFLD_v2 performant implementation:
`pytest tests/ttnn/integration_tests/UFLD_v2/test_UFLD_v2_performant.py::test_run_ufld_v2_trace_2cq_inference`

### Owner: [Venkatesh](https://github.com/vguduruTT)
30 changes: 30 additions & 0 deletions models/experimental/functional_UFLD_v2/demo/GT_test_labels.json

Large diffs are not rendered by default.

388 changes: 388 additions & 0 deletions models/experimental/functional_UFLD_v2/demo/demo.py

Large diffs are not rendered by default.

Loading
Loading