Feat/fastino privacy mode#4
Open
sinonchum wants to merge 8 commits into
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
This PR introduces a dedicated Local Privacy Mode to PatentFlow. We have successfully integrated a custom, fine-tuned local LLM to handle highly sensitive, un-published European Patent Office (EPO) Office Actions, ensuring that no confidential data ever leaves the user's infrastructure.
How was it built?
We utilized the Pioneer by Fastino platform to train a specialized model (Llama-3.1-8B-Instruct). By feeding the Pioneer Agent our proprietary seed dataset of EPC Art. 123(2)/56/84 constraints, we achieved a highly accurate model that strictly adheres to our required JSON schema for legal parsing.
Why does this matter? (The Business Value)
In the legal industry, data privacy is non-negotiable. With this update, law firms are no longer forced to rely on public APIs (like OpenAI) for sensitive IP documents. Instead, they can:
Use Own Compute: Download this Fastino-trained model and run it entirely on their own local servers or private cloud.
Ensure NDA Compliance: Process proprietary inventions and unpublished claims with zero risk of data leakage.
Production-Ready: Transition PatentFlow from a proof-of-concept to a production-ready tool that law firms can confidently use for real, day-to-day drafting and analysis.
Technical Highlights:
Added a new FastinoClient (skills/engine/fastino_client.py) fully compatible with the OpenAI SDK standard.
Implemented Shadow Routing: A seamless toggle (ENABLE_LOCAL_PRIVACY_MODE) allows users to switch between the public fast-path and the local privacy-path.
Added robust fallback mechanisms to ensure high availability during inference.