Use pytest --disable-warnings --input-path="models/demos/bert/demo/input_data.json" models/demos/bert/demo/demo.py::test_demo[models.demos.bert.tt.ttnn_bert-phiyodr/bert-large-finetuned-squad2] to run the demo.
If you wish to run the demo for ttnn_optimized_bert, use pytest --disable-warnings --input-path="models/demos/bert/demo/input_data.json" models/demos/bert/demo/demo.py::test_demo[models.demos.bert.tt.ttnn_optimized_bert-phiyodr/bert-large-finetuned-squad2] to run the demo.
If you wish to run the demo with a different input use pytest --disable-warnings --input-path="<address_to_your_json_file.json>" models/demos/bert/demo/demo.py::test_demo[models.demos.bert.tt.ttnn_bert-phiyodr/bert-large-finetuned-squad2]. This file is expected to have exactly 8 inputs.
Our second demo is designed to run SQuADV2 dataset, run this with pytest --disable-warnings models/demos/bert/demo/demo.py::test_demo_squadv2[3-models.demos.bert.tt.ttnn_optimized_bert-phiyodr/bert-large-finetuned-squad2].
If you wish to run for n_iterations samples, use pytest --disable-warnings models/demos/bert/demo/demo.py::test_demo_squadv2[<n_iterations>-models.demos.bert.tt.ttnn_optimized_bert-phiyodr/bert-large-finetuned-squad2]
Inputs by default are provided from input_data.json. If you wish you to change the inputs, provide a different path to test_demo.
We do not recommend modifying input_data.json file.
The entry point to bert model is bert_for_question_answering in models/demos/bert/tt/ttnn_bert.py (models/demos/bert/tt/ttnn_optimized_bert.py for optimized version). The model picks up certain configs and weights from huggingface pretrained model. We have used phiyodr/bert-large-finetuned-squad2 version from huggingface as our reference.