Deploying PyTorch+Gradio endpoint onto Azure-based scalable system, probably a AKS cluster (open to better ideas)

$250-750 USD

Zaprt

Objavljeno

pred 9 meseci

$250-750 USD

Plačilo ob dostavi

I have a PyTorch + Gradio codebase that I want to deploy on Azure, with efficient autoscaling. The codebase is for audio inferencing. My assumption is Azure Kubernetes would be best and most cost efficient, but I'm open to other ideas. My attempt was to use a load balancer that connects to GPU-powered instances that are auto scaled up and down based on average of connections to the individual instances. SPECIFICS: - PyTorch 2.0.1 and Python 3.8 are required for this codebase, along with the codebase's own [login to view URL] installation. I'm open to Docker usage, but in my own testing, PyTorch with GPU support is quite large and because of that, docker image downloading and extractions slows down the start time of an instance very significantly. - I would like to use spot instances as much as possible, and only fall back to an on-demand instance if there's no spot instances. Ideally, if there is an on-demand instance being used, i'd like to attempt to replace it using a spot instance when a spot instance becomes available. - Since this is an inferencing endpoint, I need minimal delay with scaling out, so this is an area where I really need the proper expertise. If things go well with us, I would definitely have additional work I would need help with. DELIVERABLES: I need to be able to configure and run this myself, and adjust things, therefore I would want to be given Azure CLI commands and config files that I could use, along with any instructions to properly configure identities, permissions, etc.

ID projekta: 37032290

Več o projektu

29 ponudb

Projekt na daljavo

Aktivno pred 8 meseci

Želite zaslužiti?

E-naslov

Prednosti oddajanja ponudb na Freelancerju

Nastavite svoj proračun in časovni okvir

Prejmite plačilo za svoje delo

Povzetek predloga

Registracija in oddajanje ponudb sta brezplačna

29 freelancerjev je oddalo ponudbo s povprečno vrednostjo $537 USD za to delo

@helmot

Hi there! I'm Vahid, a fulltime freelancer with extensive experience in AI and related technologies. I understand that you are looking for someone to help you deploy your PyTorch + Gradio codebase onto Azure, with efficient autoscaling. As a result, I believe that using a Kubernetes cluster is the best option for this project. I have extensive knowledge of Python and other programming languages, as well as databases and big data management tools. This makes me an ideal candidate for this job because I can effectively use all of these components to create an audio inference endpoint that runs efficiently on GPU-powered instances. My experience includes working with AWS services such as EC2, Lambda functions, S3 storage and API scraping. I would be more than happy to provide any needed instructions on how to properly configure identities, permissions and other components of the system so that it runs smoothly.

$500 USD v 7 dneh

4,8

(141 ocen)

7,7

@umg536

Hi there, I'm bidding on your project "Deploying PyTorch+Gradio endpoint onto Azure-based scalable system, probably a AKS cluster (open to better ideas)" Being an expert in Python and matlab programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .

$750 USD v 1 dnevu

5,0

(12 ocen)

6,3

@arifnafees

Hello Client, Greetings! I can help you to deploy Pytorch and Gradio on Azure with best possible solution, as you told that docker is not feasible due to size, then how the AKS will work without docker. Other than this, we can create the terraform code to deploy the app on auto-scaling environment in spot instances. Please feel free to discuss and get started. Being an AWS cloud expert and DevOps expert I can better do it in a professional manner. You will find me very cooperative and dedicated during work and will be happy to get a quality solution/service. I will appreciate it if you please leave me a message to discuss more details and get started. Thank you

$750 USD v 7 dneh

5,0

(30 ocen)

6,3

@sapotacorp

Hi sir, Thank you for considering our expertise to deploy PyTorch+Gradio endpoint onto an Azure-based scalable system. To gather the necessary project requirements, we would like to ask you the following questions: 1. Is there any specific reason why you've chosen PyTorch and Gradio for your endpoint? Are there any specific functionalities or features you would like to incorporate into the endpoint? 2. Are there any specific integration requirements or dependencies that need to be considered when deploying the endpoint onto Azure?. I am ready to get started right away.... Can we discuss the project details Your satisfaction is more important than money then you only need to pay when your project is completed. There are no risk for you. Thanks, Michael

$459 USD v 7 dneh

5,0

(12 ocen)

5,7

@snbhanja

Hi, I have some questions. When you say "inferencing endpoint" do you want to use Gradio Ui or use its API for inference? As, accordingly, the deployment will be done. I deployed a custom Gradio UI for image generation with my own model checkpoints and use the Gradio API for inference. I deployed in GPU serverless environment. Let's connect and discuss.

$250 USD v 5 dneh

5,0

(19 ocen)

5,2

@umairkaramat24

Hi, how are you? I go through the description and read it carefully, I know exactly what you are looking for. I have 5+ years’ experience in these skills Kubernetes, Pytorch, Microsoft Azure, Python and Azure. I have some question about this job, Please start chat, so we have detail discussion about your task. Thanks! Umair

$750 USD v 6 dneh

5,0

(15 ocen)

4,6

@rochaksharma7

Dear Client.✋ I have just read your job description and your project is really interesting to me. The Items you raised are similar to what I have already done in practice and I think you can do it in a short time if you have a little explanation. I'm an expert having specialization in--- ✔️ Embedded system based on Microcontroller (ATMEGA, AVR, STM8, STM32, MSP430, TMS320, PIC ...) ✔️ Python with Deep Learning, Machine Learning ✔️ Python with Data Science ✔️ A system based on development boards(Arduino, Raspberry PI, Node MCU, Bluechip, Teensy,…) ✔️ Bluetooth, WIFI, zigbee, LoRA ✔️ PCB layout designing, providing GERBER and BOMs, 3D files using Altium, EAGLE, Kicad, EasyEDA… ✔️ Programming firmware of Microcontroller & C++ I think my many design and practical experiences can help you design your project and give you enough satisfaction. I look forward to your response. Best Regards.

$500 USD v 17 dneh

5,0

(34 ocen)

4,4

@Sh1r0

Hi, Your project caught my attention as I have an extensive experience in working with deploying machine learning models and use of Azure scalable systems. I understand from your posting that you have a codebase built with PyTorch and Gradio for audio inferencing, and you want to deploy this onto Azure, ideally using AKS cluster. As an AI engineer with a focus on MLOps, I’m confident in assisting with your project; deploying and auto-scaling your PyTorch + Gradio audio inferencing code on Azure via AKS cluster. 1. Docker Optimization: I'll rectify the slow start times of instances by optimizing the Docker-PyTorch GPU download & extraction process. 2. Spot Instances: I'll design the deployment for maximal use of cost-effective spot instances, with a fallback mechanism to on-demand instances only when necessary. A seamless transition back to spot instances will be put in place when they become available. 3. Minimal Scaling Delay: To meet this requirement, I propose using Azure's KEDA. It provides efficient event-based autoscaling, ensuring your inferencing endpoint responds rapidly. Upon project completion, you'll receive a set of Azure CLI commands, configuration files, and a comprehensive guide to familiarize you with the system setup. I would be more than glad to discuss this proposal further and get started on this project. If this project is a success, I look forward to working with you on further work you need help with. Sincerely, Chansa

$567 USD v 7 dneh

5,0

(5 ocen)

3,6

@hussainmuzammal4

╰┈➤╰┈➤╰┈➤⚠⚠⚠⚠⚠⚠ ⭐Hello,⚡⚡⚡⚡⚡⚡ I read through the details extremely carefully and ⭐I am confident I can exceed your expectations. I have long experience with right skills to work on this project. I have received strong feedback on the ability to deliver high-quality work ⭐╰┈➤ ⚠⚠⚠

$250 USD v 2 dneh

4,6

(3 ocen)

2,6

@manpreetkaur991

Hello there! My name is Manpreet, and I am a senior web and mobile developer with extensive experience in Python and related technologies. I understand that you are looking for someone to help with the deployment of PyTorch+Gradio onto Azure, with efficient autoscaling. I believe that my skillset makes me the best fit for this project - specifically my experience with building back-end Web applications using PHP, NodeJS, *SQL, NoSQL (MongoDB) and JavaScript (vanilla, jQuery). Additionally, I have used other Web and UNIX technologies such as HTML5 & CSS (LESS/SASS/SCSS) which will be required for this project. I would be delighted to discuss this project in more detail if you are interested. Please do not hesitate to contact me if you have any questions or would like to take this discussion further at any point in the future. Thanks

$500 USD v 7 dneh

3,8

(1 ocena)

3,2

@ZainMustafaH

I understand that you are looking for someone to help you with the deployment of your PyTorch+Gradio codebase onto Azure, with efficient autoscaling. From my experience as a data scientist and Ai developer, I have the necessary skills to provide the necessary services needed for this project to succeed. My core skills include computer vision, web scraping, natural language processing, and object detection projects in Python. Additionally, I have expertise in machine learning and artificial intelligence techniques such as classification, regression, association rule mining, clustering, dimensionality reduction, natural language processing and time series forecasting. I am confident that my team and I would be able to successfully complete this project. If given the proper instructions and access to the necessary files/commands we would be able to configure identities permissions etc to enable us to start working on this project right away without having to wait for specific times before scaling out further

$700 USD v 7 dneh

5,0

(2 ocen)

1,3

@THgolden

( ͡❛ ᴗ ͡❛ )Hi, Max F.✔️ I read your suggestion carefully. I've gone through the job posting. It seems that you're looking for a software engineer who have rich experiences on Kubernetes, Microsoft Azure, Python, Pytorch and Azure. I can do it perfectly. ✔️NO PROBLEM!!!✔️ I am ready to start work immediately and will work full-time for you. I hope to make another perfect result with an excellent client. Looking forward to working with you. Regards, Tetiana

$333 USD v 3 dneh

0,0

(0 ocen)

0,0

@Saviourest

✌Hello, Max F.✌ Okay I got what you want exactly. I just checked your project details ⭐Deploying PyTorch+Gradio endpoint onto Azure-based scalable system, probably a AKS cluster (open to better ideas)⭐ and it matches my expertise. I absolutely love this job description. The first reason I love this job is because I can tell there is a lot of very technical tasks to do which I absolutely love. The second reason is that I have the required experience so I should be very comfortable with anything you throw at me. Let me know if we can discuss more. I can share my updated CV with you so you can decide. I 'd love to discuss more details with you. Best Regards. Dima

$400 USD v 5 dneh

5,0

(1 ocena)

0,0

@Kilian1337

Hello, Sound like there could be a fit here, I've done a ton of web scraping for other Clients. I know it can get challenging (and time-consuming) to create the perfect python script. Most of my clients tell me that they don't have the time to spend hours learning how to code or fixing their script. The simple solution: Let me handle it. Here are some of the Projects I've worked on: - Python Web Scraping built with Requests, Beautiful Soup, Pandas and MySQL Database. - Python OpenCV detection for Online Casinos. - Python Card Counting Simulator in tkinter. - Python Web Scraping built with Requests and Pandas that stores the values in a spreadsheet (Microsoft Excel). - YouTube Video Upload Bot (without Google API) in Python with Selenium, Web Driver and UndetectedChromeDriver Sounds like a fit? Shoot me a message and let's discuss the details! Best Regards, Kilian

$487,33 USD v 7 dneh

0,0

(0 ocen)

0,0

@REPLATechnology

Dear Client We understand your requirements for low-latency inferencing, optimal resource utilization, and cost efficiency. Our proposal outlines a comprehensive approach to achieve these objectives using Azure Kubernetes Service (AKS) and spot instances, while also considering your specific technology stack and needs. We will set up your codebase within Azure Kubernetes Service (AKS), leveraging Kubernetes for orchestration, scaling, and managing containerized applications. Our solution will implement efficient autoscaling using spot instances whenever possible to minimize costs. Our expertise in AKS and Kubernetes will enable us to fine-tune autoscaling triggers and thresholds to minimize delay in scaling out based on connection demand. We will provide you with Azure CLI commands, Helm charts, and configuration files that enable you to deploy and manage your application, including proper setup of identities and permissions. If our proposal aligns with your goals, we would love to discuss the project in more detail. We look forward to the opportunity to collaborate and create a robust and cost-effective solution. Best regards

$700 USD v 18 dneh

0,0

(0 ocen)

0,0

@dreamerherry

Hello There, We're ready to start your work immediately. We can surely help you with Python audio inferencing project. We have fluent expertise in this kind of work & we have all kinds of skills and abilities which save your time and cost. * Let's have a chat so I can share my past work for your kind consideration. *****Why Choose Empiric Infotech***** -> Our team has a proven track record of successfully delivering MEAN, MERN, AI, ML, Python, and Blockchain projects, and we have a deep understanding of all the latest technologies. -> 7+ years of experience in all the latest technology. -> Best quality assurance and provide bug-free code. -> Transparent communication with our clients. -> Our top priority is client satisfaction. I am glad to say we have all kinds of skills and abilities which are quite beneficial for this job. Please have a look at my freelancer profile: https://www.freelancer.in/u/dreamerherry so you can get an idea about my skills and work abilities for your project. Q.1 Can you please share some more details about your requirements? or we can discuss them on chat or call. Thank you for considering Empiric Infotech for this opportunity. We look forward to discussing the project further and demonstrating our skills and dedication to your team. Regards, Empiric Infotech

$499 USD v 5 dneh