Find Jobs
Hire Freelancers

Adding some Hardcoded examples in Generations through BigCode Harness Code

₹600-2000 INR

Zaprt
Objavljeno pred 11 meseci

₹600-2000 INR

Plačilo ob dostavi
The code generation LM evaluation harness is a framework designed to evaluate code generation models. It is inspired by the EleutherAI/lm-evaluation-harness, which focuses on evaluating language models in general. The evaluation harness supports various code generation tasks and provides features such as multi-GPU text generation, Docker support for security and reproducibility, and compatibility with autoregressive models available on the Hugging Face model hub. Code generation Python tasks: The harness includes four code generation Python tasks, namely HumanEval, APPS, MBPP, and DS-1000. These tasks can be evaluated using both completion (left-to-right) and insertion (FIM) modes. The task is to modify the [login to view URL] file in the lm_eval package to append hard-coded prompts and solutions from the HumanEval dataset (below link) to the TokenizedDataset. [login to view URL]
ID projekta: 36762647

Več o projektu

2 ponudb
Projekt na daljavo
Aktivno pred 10 meseci

Želite zaslužiti?

Prednosti oddajanja ponudb na Freelancerju

Nastavite svoj proračun in časovni okvir
Prejmite plačilo za svoje delo
Povzetek predloga
Registracija in oddajanje ponudb sta brezplačna

O stranki

Zastava INDIA
Bhopal, India
5,0
6
Plačilna metoda je verificirana
Član(ica) od sep. 17, 2022

Verifikacija stranke

Hvala! Po e-pošti smo vam poslali povezavo za prevzem brezplačnega dobropisa.
Pri pošiljanju vašega e-sporočila je šlo nekaj narobe. Poskusite znova.
Registrirani uporabniki Skupaj objavljenih del
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Nalaganje predogleda
Geolociranje je bilo dovoljeno.
Vaša prijavna seja je potekla, zato ste bili odjavljeni. Prosimo, da se znova prijavite.