CHANGELOG.md

1.6.0 (2024-06-09)

Features

• Add tests for RobotsNode and update test setup (dedfa2e)

Test

• Enhance JSON scraping pipeline test (d845a1b)

1.5.7 (2024-06-06)

Bug Fixes

• update openai tts class (10672d6)

1.5.6 (2024-06-05)

Bug Fixes

• getter (67d83cf)

1.5.5 (2024-06-05)

Bug Fixes

• bug on generate_answer_node (1d38ed1)

Docs

• add Japanese README (4559ab6)
• update japanese.md (f0042a8)
• update README.md (871e398)

1.5.4 (2024-05-31)

Bug Fixes

• 3.9: python 3.9 logging fix (8be27ba)

1.5.3 (2024-05-30)

Bug Fixes

• typo in generate_screper_node (c4ce361)

1.5.2 (2024-05-26)

Bug Fixes

• fixed typo (54e8216)
• Update init.py (8f2c8d5)

1.5.1 (2024-05-26)

Bug Fixes

• pdf-example: added pdf example and coauthor (a796169)
• schema: added schema (8d76c4b)

1.5.0 (2024-05-26)

Features

• knowledgegraph: add knowledge graph node (0196423)
• add logger integration (e53766b)
• smart-scraper-multi: add schema to graphs and created SmartScraperMultiGraph (fc58e2d)
• burr: added burr integration in graphs and optional burr installation (ac10128)
• base_graph: alligned with main (73fa31d)
• burr-bridge: BurrBridge class to integrate inside BaseGraph (6cbd84f)
• verbose: centralized graph logging on debug or warning depending on verbose (c807695)
• burr: first burr integration and docs (19b27bb)
• node: knowledge graph node (8c33ea3)
• version: python 3.12 is now supported 🚀 (5fb9115)
• multiple: quick fix working (58cc903)
• kg: removed import (a338383)
• docloaders: undetected-playwright (7b3ee4e)
• burr-node: working burr bridge (654a042)
• multiple_search: working multiple example (bed3eed)
• kg: working rag kg (c75e6a0)

Bug Fixes

• error in jsons (ca436ab)
• pdf_scraper: fix the pdf scraper gaph (d00cde6)
• local_file: fixed textual input pdf, csv, json and xml graph (8d5eb0b)
• kg: removed unused nodes and utils (5684578)
• logger: set up centralized root logger in base node (4348d4f)
• logging: source code citation (d139480)
• template names (b82f33a)
• node-logging: use centralized logger in each node for logging (c251cc4)
• web-loader: use sublogger (0790ecd)

Docs

• burr: added dependecies and switched to furo (819f071)
• faq: added faq section and refined installation (545374c)
• graph: added new graphs and schema (d27cad5)
• updated requirements (e43b801)

CI

• release: 1.2.0-beta.1 [skip ci] (fd3e0aa)
• release: 1.3.0-beta.1 [skip ci] (191db0b)
• release: 1.4.0-beta.1 [skip ci] (2caddf9)
• release: 1.4.0-beta.2 [skip ci] (f1a2523)
• release: 1.5.0-beta.1 [skip ci] (e1006f3)
• release: 1.5.0-beta.2 [skip ci] (edf221d)
• release: 1.5.0-beta.3 [skip ci] (90d5691)
• release: 1.5.0-beta.4 [skip ci] (15b7682)
• release: 1.5.0-beta.5 [skip ci] (1f51147)

1.5.0-beta.5 (2024-05-26)

Features

• version: python 3.12 is now supported 🚀 (5fb9115)

Docs

• faq: added faq section and refined installation (545374c)
• updated requirements (e43b801)

1.5.0-beta.4 (2024-05-25)

Features

• burr: added burr integration in graphs and optional burr installation (ac10128)
• burr-bridge: BurrBridge class to integrate inside BaseGraph (6cbd84f)
• burr: first burr integration and docs (19b27bb)
• burr-node: working burr bridge (654a042)

Docs

• burr: added dependecies and switched to furo (819f071)
• graph: added new graphs and schema (d27cad5)

1.5.0-beta.3 (2024-05-24)

Bug Fixes

• kg: removed unused nodes and utils (5684578)

1.5.0-beta.2 (2024-05-24)

Bug Fixes

• pdf_scraper: fix the pdf scraper gaph (d00cde6)
• local_file: fixed textual input pdf, csv, json and xml graph (8d5eb0b)

1.5.0-beta.1 (2024-05-24)

Features

• knowledgegraph: add knowledge graph node (0196423)
• add logger integration (e53766b)
• smart-scraper-multi: add schema to graphs and created SmartScraperMultiGraph (fc58e2d)
• base_graph: alligned with main (73fa31d)
• verbose: centralized graph logging on debug or warning depending on verbose (c807695)
• node: knowledge graph node (8c33ea3)
• multiple: quick fix working (58cc903)
• kg: removed import (a338383)
• docloaders: undetected-playwright (7b3ee4e)
• multiple_search: working multiple example (bed3eed)
• kg: working rag kg (c75e6a0)

Bug Fixes

• error in jsons (ca436ab)
• logger: set up centralized root logger in base node (4348d4f)
• logging: source code citation (d139480)
• template names (b82f33a)
• node-logging: use centralized logger in each node for logging (c251cc4)
• web-loader: use sublogger (0790ecd)

CI

• release: 1.2.0-beta.1 [skip ci] (fd3e0aa)
• release: 1.3.0-beta.1 [skip ci] (191db0b)
• release: 1.4.0-beta.1 [skip ci] (2caddf9)
• release: 1.4.0-beta.2 [skip ci] (f1a2523)

1.4.0-beta.2 (2024-05-19)

Features

• Add new models and update existing ones (58289ec)

1.3.2 (2024-05-22)

Bug Fixes

• pdf scraper bug (f2dffe5)

1.3.1 (2024-05-21)

Bug Fixes

• add deepseek embeddings (659fad7)

1.3.0 (2024-05-19)

Features

• add new model (8c7afa7)

1.2.4 (2024-05-17)

Bug Fixes

• deepcopy: switch whether we have obj in the config (d4d913c)

1.2.3 (2024-05-15)

Bug Fixes

• deepcopy: reaplced to shallow copy (999c930)

1.2.2 (2024-05-15)

Bug Fixes

• come back to the old version (cc5adef)

1.2.1 (2024-05-15)

Bug Fixes

• removed unused (5587a64)

1.2.0 (2024-05-15)

Features

• add finalize_node() (6e7283e)

1.1.0 (2024-05-15)

Features

• add turboscraper (alfa) (51aa109)
• new search_graph (67d5fbf)

Docs

• rye: replaced poetry with rye (efb781f)

1.0.1 (2024-05-15)

Bug Fixes

• searchgraph: used shallow copy to serialize obj (096b665)

1.0.0 (2024-05-15)

⚠ BREAKING CHANGES

• package manager: move from poetry to rye

chore

• package manager: move from poetry to rye (8fc2510), closes #198

Docs

• main-readme: fixed some typos (78d1940)

0.11.1 (2024-05-14)

Bug Fixes

• docs: requirements-dev (b0a67ba)

0.11.0 (2024-05-14)

Features

• parallel-exeuction: add asyncio event loop dispatcher with semaphore for parallel graph instances (627cbee)
• webdriver-backend: add dynamic import scripts from module and file (db2234b)
• add gpt-4o (52a4a3b), closes #232
• add new prompt info (e2350ed)
• proxy-rotation: add parse (IP address) or search (from broker) functionality for proxy rotation (2170131)
• add support for deepseek-chat (156b67b), closes #222
• Add support for passing pdf path as source (f10f3b1)
• omni-search: added omni search graph and updated docs (fcb3abb)
• added proxy rotation (0c36a7e)
• safe-web-driver: enchanced the original AsyncChromiumLoader web driver with proxy protection and flexible kwargs and backend (768719c)
• gpt-4o: image to text single node test (90955ca)
• revert fetch_node (864aa91)
• batchsize: tested different batch sizes and systems (a8d5e7d)
• update info (4ed0fb8)
• omni-scraper: working OmniScraperGraph with images (a296927)

Bug Fixes

• pytest: add dependency for mocking testing functions (2f4fd45)
• add json integration (0ab31c3)
• Augment the information getting fetched from a webpage (f8ce3d5)
• bug for claude (d0167de)
• fetch_node: bug in handling local files (a6e1813)
• chromium-loader: ensure it subclasses langchain's base loader (b54d984)
• fixed bugs for csv and xml (324e977)
• limit python version to < 3.12 (a37fbbc)
• proxy-rotation: removed duplicated arg and passed the loader_kwarhs correctly to the node (1e9a564)
• fetch-node: removed isSoup from default (0c15947)
• proxy-rotation: removed max_shape duplicate (5d6d996)
• asyncio: replaced deepcopy with copy due to serialization problems (dedc733)

chore

• update models_tokens.py with new model configurations (d9752b1)

Docs

• add diagram showing general structure/flow of the library (13ae918)
• refactor: added proxy-rotation usage and refactor readthedocs (e256b75)
• refactor: changed example (c7ec114)
• concurrent: refactor theme and added benchmarck searchgraph (ced2bbc)
• update overview diagram with more models (b441b30)

CI

• release: 0.10.0-beta.3 [skip ci] (ad32298)
• release: 0.10.0-beta.4 [skip ci] (548bff9)
• release: 0.10.0-beta.5 [skip ci] (28c9dce)
• release: 0.10.0-beta.6 [skip ci] (460d292)
• release: 0.11.0-beta.1 [skip ci] (63c0dd9)
• release: 0.11.0-beta.10 [skip ci] (218b8ed), closes #232
• release: 0.11.0-beta.11 [skip ci] (8727d03)
• release: 0.11.0-beta.2 [skip ci] (7ae50c0)
• release: 0.11.0-beta.3 [skip ci] (106fb12), closes #222
• release: 0.11.0-beta.4 [skip ci] (4ccddda)
• release: 0.11.0-beta.5 [skip ci] (353382b)
• release: 0.11.0-beta.6 [skip ci] (2724d3d)
• release: 0.11.0-beta.7 [skip ci] (f0f7373)
• release: 0.11.0-beta.8 [skip ci] (fa4edb4)
• release: 0.11.0-beta.9 [skip ci] (d2877d8)

0.11.0-beta.11 (2024-05-14)

Features

• omni-search: added omni search graph and updated docs (fcb3abb)
• gpt-4o: image to text single node test (90955ca)
• omni-scraper: working OmniScraperGraph with images (a296927)

Bug Fixes

• fetch_node: bug in handling local files (a6e1813)

0.11.0-beta.10 (2024-05-14)

Features

• add gpt-4o (52a4a3b), closes #232

0.11.0-beta.9 (2024-05-14)

Bug Fixes

• crash asyncio due dependency version (2563773)

chore

• update models_tokens.py with new model configurations (d9752b1)

Docs

• fixed speechgraphexample (4bf90f3)
• fixed unused param and install (cc28d5a)
• readme: improve main readme (ae5655f)
• concurrent: refactor theme and added benchmarck searchgraph (ced2bbc)
• update instructions to use with LocalAI (198420c)
• Update README.md (772e064)
• updated sponsor logo (f8d8d71)

CI

• release: 0.10.1 [skip ci] (d359814)

0.11.0-beta.8 (2024-05-13)

Features

• parallel-exeuction: add asyncio event loop dispatcher with semaphore for parallel graph instances (627cbee)
• batchsize: tested different batch sizes and systems (a8d5e7d)

Bug Fixes

• asyncio: replaced deepcopy with copy due to serialization problems (dedc733)

0.11.0-beta.7 (2024-05-13)

Bug Fixes

• bug for claude (d0167de)

Docs

• refactor: changed example (c7ec114)

0.11.0-beta.6 (2024-05-13)

Bug Fixes

• fetch-node: removed isSoup from default (0c15947)

0.11.0-beta.5 (2024-05-13)

Features

• webdriver-backend: add dynamic import scripts from module and file (db2234b)
• proxy-rotation: add parse (IP address) or search (from broker) functionality for proxy rotation (2170131)
• added proxy rotation (0c36a7e)
• safe-web-driver: enchanced the original AsyncChromiumLoader web driver with proxy protection and flexible kwargs and backend (768719c)

Bug Fixes

• pytest: add dependency for mocking testing functions (2f4fd45)
• chromium-loader: ensure it subclasses langchain's base loader (b54d984)
• proxy-rotation: removed duplicated arg and passed the loader_kwarhs correctly to the node (1e9a564)
• proxy-rotation: removed max_shape duplicate (5d6d996)

Docs

• refactor: added proxy-rotation usage and refactor readthedocs (e256b75)

0.11.0-beta.4 (2024-05-12)

Features

• add new prompt info (e2350ed)

0.11.0-beta.3 (2024-05-12)

Features

• add support for deepseek-chat (156b67b), closes #222

Docs

• add diagram showing general structure/flow of the library (13ae918)
• update overview diagram with more models (b441b30)

0.11.0-beta.2 (2024-05-10)

Features

• revert fetch_node (864aa91)

0.11.0-beta.1 (2024-05-10)

Features

• Add support for passing pdf path as source (f10f3b1)
• update info (4ed0fb8)

Bug Fixes

• add json integration (0ab31c3)
• Augment the information getting fetched from a webpage (f8ce3d5)
• fixed bugs for csv and xml (324e977)
• limit python version to < 3.12 (a37fbbc)

CI

• release: 0.10.0-beta.3 [skip ci] (ad32298)
• release: 0.10.0-beta.4 [skip ci] (548bff9)
• release: 0.10.0-beta.5 [skip ci] (28c9dce)
• release: 0.10.0-beta.6 [skip ci] (460d292)

Bug Fixes

• add json integration (0ab31c3)

0.10.0-beta.5 (2024-05-09)

Bug Fixes

• fixed bugs for csv and xml (324e977)

0.10.0-beta.4 (2024-05-09)

Features

• Add support for passing pdf path as source (f10f3b1)

Bug Fixes

• limit python version to < 3.12 (a37fbbc)

0.10.0-beta.3 (2024-05-09)

Features

• update info (4ed0fb8)

0.10.0-beta.2 (2024-05-08)

Bug Fixes

• examples: local, mixed models and fixed SearchGraph embeddings problem (6b71ec1)
• examples: openai std examples (186c0d0)
• removed .lock file for deployment (d4c7d4e)

Docs

• update README.md (17ec992)

0.10.0-beta.1 (2024-05-06)

Features

• add claude documentation (5bdee55)
• add gemini embeddings (79daa4c)
• add llava integration (019b722)
• add new hugging_face models (d5547a4)
• Fix bug for gemini case when embeddings config not passed (726de28)
• fixed custom_graphs example and robots_node (84fcb44)
• multiple graph instances (dbb614a)
• node: multiple url search in SearchGraph + fixes (930adb3)
• refactoring search function (aeb1acb)

Bug Fixes

• bug on .toml (f7d66f5)
• llm: fixed gemini api_key (fd01b73)

CI

• release: 0.9.0-beta.2 [skip ci] (5aa600c)
• release: 0.9.0-beta.3 [skip ci] (da8c72c)
• release: 0.9.0-beta.4 [skip ci] (8c5397f)
• release: 0.9.0-beta.5 [skip ci] (532adb6)
• release: 0.9.0-beta.6 [skip ci] (8c0b46e)
• release: 0.9.0-beta.7 [skip ci] (6911e21)
• release: 0.9.0-beta.8 [skip ci] (739aaa3)

0.9.0-beta.8 (2024-05-06)

Features

• add llava integration (019b722)

0.9.0-beta.7 (2024-05-06)

Bug Fixes

• llm: fixed gemini api_key (fd01b73)

0.9.0-beta.6 (2024-05-06)

Features

• Fix bug for gemini case when embeddings config not passed (726de28)

0.9.0-beta.5 (2024-05-06)

Features

• fixed custom_graphs example and robots_node (84fcb44)
• multiple graph instances (dbb614a)
• node: multiple url search in SearchGraph + fixes (930adb3)

0.9.0-beta.4 (2024-05-05)

Features

• add gemini embeddings (79daa4c)

0.9.0-beta.3 (2024-05-05)

Features

• add claude documentation (5bdee55)

0.9.0-beta.2 (2024-05-05)

Features

• refactoring search function (aeb1acb)

Bug Fixes

• bug on .toml (f7d66f5)

0.9.0-beta.1 (2024-05-04)

Features

• Enable end users to pass model instances of HuggingFaceHub (7599234)

Build

• deps: bump tqdm from 4.66.1 to 4.66.3 (0a17c74)
• deps: bump tqdm from 4.66.1 to 4.66.3 (aff6f98)

CI

• release: 0.8.0-beta.1 [skip ci] (d277b34)
• release: 0.8.0-beta.2 [skip ci] (892500a)

0.8.0 (2024-05-03)

Features

• add pdf scraper (10a9453)

CI

• release: 0.7.0-beta.3 [skip ci] (fbb06ab)

0.7.0 (2024-05-03)

Features

• add base_node to init.py (cb1cb61)
• Azure implementation + embeddings refactoring (aa9271e)

Refactor

• Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model. (819cbcd)

CI

• release: 0.7.0-beta.1 [skip ci] (98dec36)
• release: 0.7.0-beta.2 [skip ci] (42fa02e)

0.7.0-beta.3 (2024-05-03)

0.7.0-beta.2 (2024-05-03)

Features

• Azure implementation + embeddings refactoring (aa9271e)
• add pdf scraper (10a9453)

Refactor

• Changed the way embedding model is created in AbstractGraph class and removed handling of embedding model creation from RAGNode. Now AbstractGraph will call a dedicated method for embedding models instead of _create_llm. This makes it easy to use any LLM with any supported embedding model. (819cbcd)

0.7.0-beta.1 (2024-05-03)

Features

• add base_node to init.py (cb1cb61)

0.6.2 (2024-05-02)

Bug Fixes

• add to requirements.txt langchain-aws = "^0.1.2" (1afa319)

Docs

• tree: added roadmap (c8eeff8)
• roadmap: open contributions (4441505)
• typo (faa3498)

CI

• release: 0.6.1-beta.1 [skip ci] (75a4042)

0.6.1 (2024-05-02)

Bug Fixes

• gemini errror (2ea54ea)

0.6.0 (2024-05-02)

Features

• added node and graph for CSV scraping (4d542a8)
• Allow end users to pass model instances for llm and embedding model (b86aac2)
• modified node name (02d1af0)

CI

• release: 0.5.0-beta.7 [skip ci] (40b2a34)
• release: 0.5.0-beta.8 [skip ci] (c11331a)

0.5.2 (2024-05-02)

Bug Fixes

• bug on script_creator_graph.py (4a3bc37)

0.5.1 (2024-05-02)

Bug Fixes

• examples and graphs (5cf4e4f)

Docs

• added venv suggestion (ba2b24b)
• base and fetch node (e981796)
• change contributing.md with new ci/cd workflow (3e91a46)
• fixed basegraph docstring (29427c2)
• graphs and helpers docstrings (0631985)
• refactor examples (c11fc28)
• refactor models docstrings (18c20eb)
• refactor nodes docstrings (1409797)
• update utils docstrings (cf038b3)

0.5.0 (2024-04-30)

Features

• add cluade integration (e0ffc83)
• add co-author (719a353)
• fetch: added playwright support (42ab0aa)
• added verbose flag to suppress print statements (2dd7817)
• base groq + requirements + toml update with groq (7dd5b1a)
• refactor: changed variable names (8fba7e5)
• llm: implemented groq model (dbbf10f)
• updated requirements.txt (d368725)

Bug Fixes

• script generator and add new benchmarks (e3d0194)

CI

• release: 0.4.0-beta.3 [skip ci] (d13321b)
• release: 0.5.0-beta.1 [skip ci] (450291f)
• release: 0.5.0-beta.2 [skip ci] (ff7d12f)
• release: 0.5.0-beta.3 [skip ci] (7e81f7c)
• release: 0.5.0-beta.4 [skip ci] (14e56f6)
• release: 0.5.0-beta.5 [skip ci] (5ac97e2)
• release: 0.5.0-beta.6 [skip ci] (9356124)

0.5.0-beta.6 (2024-04-30)

Features

• added verbose flag to suppress print statements (2dd7817)

0.5.0-beta.5 (2024-04-30)

Features

• refactor: changed variable names (8fba7e5)

0.5.0-beta.4 (2024-04-30)

Bug Fixes

• script generator and add new benchmarks (e3d0194)

0.5.0-beta.3 (2024-04-30)

Features

• add cluade integration (e0ffc83)

0.5.0-beta.2 (2024-04-30)

Features

• fetch: added playwright support (42ab0aa)

0.5.0-beta.1 (2024-04-30)

Features

• add co-author (719a353)
• base groq + requirements + toml update with groq (7dd5b1a)
• llm: implemented groq model (dbbf10f)
• updated requirements.txt (d368725)

CI

• release: 0.4.0-beta.3 [skip ci] (d13321b)

0.4.1 (2024-04-28)

Bug Fixes

• added missing dependecies (7f1c3b7)

0.4.0 (2024-04-28)

Features

• add new proxy rotation function (f6077d1)

Bug Fixes

• bug for calculate costs (a9b11e4)
• bug with fetch node (9cd5165)
• changed proxy function (b754dd9)
• robot node and proxyes (adbc08f)

CI

• release: 0.4.0-beta.1 [skip ci] (4bc7274)
• release: 0.4.0-beta.2 [skip ci] (3c77acb)

0.4.0-beta.2 (2024-04-27)

Bug Fixes

• robot node and proxyes (adbc08f)

0.4.0-beta.1 (2024-04-27)

Features

• add new proxy rotation function (f6077d1)

Bug Fixes

• changed proxy function (b754dd9)

0.3.0 (2024-04-26)

Features

• trigger new beta release (26c92c3)
• trigger new beta release (6f028c4)

CI

• release: 0.3.0-beta.1 [skip ci] (b481fd7)
• release: 0.3.0-beta.2 [skip ci] (7c8dbb8)
• add ci workflow to manage lib release with semantic-release (92cd040)
• remove pull request trigger and fix plugin release train (876fe66)

0.3.0-beta.2 (2024-04-26)

Features

• trigger new beta release (26c92c3)

0.3.0-beta.1 (2024-04-26)

Features

• trigger new beta release (6f028c4)

CI

• add ci workflow to manage lib release with semantic-release (92cd040)
• remove pull request trigger and fix plugin release train (876fe66)