GSOC AI_API_EVAL Poc submission #717
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
initial idea_harsh_panchal_AI_API_EVAL.md
|
code? |
|
@ashitaprasad I have integrated the code, please review it and open for feedback |
7 tasks
|
Thanks for submitting the PR. We have reviewed the PoC 👍 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Description
This Proof of Concept (PoC) showcases an AI API evaluation framework that evaluates AI models using industry-standard metrics like BLEU, ROUGE, BERTScore, and METEOR. It provides real-time performance insights, including latency and cost analysis. Future enhancements will include model comparisons for users and the ability to download detailed evaluation reports for comprehensive analysis.
Steps to run python backend
Clone AI API Evaluation Repository
git clone https://github.com/GANGSTER0910/AI_API_EVAL.git
pip install -r requirements.txt
Provide your Hugging Face API token in the FastAPI.py file
run python FastAPI.py
Related Issues
Checklist
I have gone through the contributing guide
I have updated my branch and synced it with project
mainbranch before making this PRI am using the latest Flutter stable branch (run
flutter upgradeand verify)I have run the tests (
flutter test) and all tests are passingYes
No, and this is why: please replace this line with details on why tests have not been included
OS on which you have developed and tested the feature?