Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade to Linux 6.8 Kernel & Drop TLS #100

Open
wants to merge 23 commits into
base: main
Choose a base branch
from
Open

Upgrade to Linux 6.8 Kernel & Drop TLS #100

wants to merge 23 commits into from

Conversation

ashvardanian
Copy link
Collaborator

@ashvardanian ashvardanian commented May 13, 2024 •
edited

  • Drop TLS 💣
  • Acceleratre io_uring engine with zero-copy and other pre-v6.8 kernel functionality
  • Unify benchmarks & examples into a monolith, to make server benchmarks more reproducible
    • FastAPI
    • UCall for Python
    • UCall for C++
    • GoLang
    • Lua
  • Reimplement clients to cover much broader functionality
    • GoLang
    • HTTPX for Python
    • cURL for C++
  • Dynamic server-side re-batching
    • UCall for C++
    • UCall for Python

ashvardanian and others added 16 commits March 6, 2024 06:07
@ashvardanian
Make: Move Python implementation
2e34bad
@ashvardanian
Fix: Deprecated Py_SetProgramName
90681af
@ashvardanian
Add: Batch APIs
c430ab2
@ashvardanian
Fix: Redis example compilation
0b0de9e
@ashvardanian
Make: Refactor builds
9cb5f08
@ashvardanian
Chore: Remove certrificates
3737d94
@MarkReedZ @ashvardanian
Make: Remove mbedtls (#97)
611921c 
Co-authored-by: Ash Vardanian <1983160+ashvardanian@users.noreply.github.com>
@ashvardanian
Make: Reorganize builds & drop /certs/
09f18ea
@ashvardanian
Merge branch 'main-dev-repack' into main-dev
f3d3ef1
@ashvardanian
Make: Temporarily preset -mavx2
e311172
@ashvardanian
Improve: New server examples in C++ & Py
47379b2
@ashvardanian
Make: Fix missing SSL symbols
ef7e825
@ashvardanian
Make: Auto-detect io_uring in CMake
b1b3360
@ashvardanian
Improve: Refresh FastAPI server
a317a27
@ashvardanian
Improve: fastapi_server.py to be feature-complete with respect to U…
6d0aad5 
…Call server
@ashvardanian @vitaut
Fix: Running C++ & Py benchmarks
b8daf5a 
Co-authored-by: Victor Zverovich <viz@meta.com>
@ashvardanian ashvardanian changed the title Drop TLS & Drop TLS & Improve Benchmarks May 13, 2024
@ashvardanian ashvardanian changed the title Drop TLS & Improve Benchmarks Upgrade to Linux 6.8 Kernel & Drop TLS May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@ashvardanian @MarkReedZ @vitaut