Use aws for web scrapingdela

Obsežno Shiny applikacijo (spisano v programskem jeziku R) bi bilo potrebno prenesti na oblak, najboljše AWS. Aplikacija trenutno deluje lokalno brez težav, potrebno bi bilo vse spraviti v en kontenjer in spraviti na inštanco AWS, npr. Ubuntu 16.04. V prvem koraku ne bi bil potrebno nobenih log-in certifikatov in dodatne spletne varnosti, gre se samo za premik na oblak.

Description: I am looking for an experienced developer or development team to create a website with an integrated API. The website will serve as an information platform and provide dynamic content from a book. Requirements: Website Development: Design and development of a user-friendly and responsive website. Use of a content management system (CMS) like WordPress or a web framework like Django or Flask. Integration of search functions and navigation elements. API Integration: Development of a RESTful API to provide access to various parts of the book (chapters, pages, paragraphs). API endpoints such as /api/book/{chapter}, /api/book/{page}, etc., to handle requests and return the corresponding data. Database: Setup of a database (e.g., MySQL, PostgreSQL) to store...

I am seeking a proficient DevOps engineer with expertise in both AWS and Azure platforms to create a Continuous Integration and Continuous Deployment (CI/CD) pipeline. The main duty will be integrating code changes, individual software modifications, into existing code repositories. Need to create a fully functional pipeline with tech documentation and runbooks .. Key Tasks: - Develop, test, and roll out CI/CD pipeline with supporting infrastructure as Code (Kubernetes, Docker) - Manage code releases and updates with popular orchestration tools like : Jenkins , Ansible Ideal Skills: - Proficiency with AWS and Azure cloud platforms - Strong experience with CI/CD - Adeptness with Python, PowerShell programming or any other popular scripting language This job demands the ...

I'm looking for a freelancer to help me extract financial data and regulatory filings from a tax website. This involves scrapping website using the provided credentials by the client, i am looking for getting the python code as i can run the code myself in the future or integrate it to another system. Key Requirements: - I need approximately 300 data points extracted. - The output for these data points should be organized into a PDF or Word. This project is about creating an automated system to generate instant reports about a company. Only difficulty is the website has drops downs to select the period involved and in those 300 data points actually many come from the same source. Ideal Skills and Experience: - Experience in web scraping (Python) ...

Prosimo, vpišite se ali se prijavite za več podrobnosti.

I need an experienced writer to craft a formal text for my personal use. The text will serve as an introductory material for my company. It's crucial that the writer I work with has a strong background in formal writing. Experience in crafting texts for personal use would be a great asset. The text will represent my company so it's important that it's engaging and professionally written. Key skills and experience required: - Proven experience in formal writing - Crafting texts for personal use - Understanding of corporate communications - Strong communication skills

we have a rds ec2 server running and we are looking for a person who can do some adjustment to it.

I need a freelancer with web scraping skills who can extract product prices and models from my 17 competitors. Ideally, the freelancer should be able to: Extract information accurately and comprehensively. Upload all the extracted information into an Excel sheet. Create a simple online website to facilitate this process. I have hosting and a domain. Enable me to update the extracted information with a single click. Complete this task within a maximum of 48 hours. Please include detailed proposals in your application on how you would approach this project.

...python3 programmer to create a sensor-data generator for the website www.voeazul.com.br. The objective is to send a POST request to the site with valid sensor-data in order to obtain a particular cookie (_abck) for data analysis purposes. The sensor data to be simulated includes mouse movements, keyboard interactions, and browser interactions. Key Requirements: - Create a sensor-data generator in Java or python3 - The generator should simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping and automation - Knowledge of coo...

i need my aws rds mysql connceted with retool. it gives error and i am unable to link it. i need help fast so only if you can help in this moment not in 1 h

It's regarding node js application and attached screen shots project details

Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database

I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide sour...

We make cozy games for mobile and cross-platform. We are an indie team focused on creating our own high quality games and IP via global free-to-play mobile games. Our mission is to championing social good and the sustainability of our ecosystems through games. Want to join a small but experienced and passionate game dev team as a full stack developer? Develop and manage code and infrastructure such as cloud server, backend databases, APIs, and automation scripts. Help build powerful game ops tools with simple frontend UI. - - - Job Specs: - Create backend solutions and integrate with cloud platforms like AWS and Digital Ocean. - Design and deploy modern frontend user interfaces using the latest UI technologies. - Build secure and scalable mobile app REST APIs. - Manage da...

...confident that my configuration is correct, but there must be something I'm missing. So I'm looking for help. I can offer 50€ plus another 50€ if you find an issue with my servers that solves the following problems, or at least some of them. - Sometimes name resolution fails when using a third-party resolver like quad8, quad9, or quad1. This happens maybe 1 out of 10 times. You can test it with the domains: , , , , , , Once the records are cached by the third-party resolve, there is no problem anymore until the records expire. - Furthermore, when I want to use them as authoritative name servers for domains bought on godaddy and strato, they are reject due to not further specified issues. I couldn't

...The task is to set up a password protected instance of the OWASP WebGoat running in AWS that is internet facing. To be successful the deployment must be: * Entirely automated using CloudFormation and bash scripts. * The landing page must be a public page protected with a username/password authentication block, this should rely upon CloudFront to perform authentication. The username and password should be configurable in the CloudFormation template. The landing page can be simple HTML that displays the username input, password input and login button. * A user friendly domain name should be configured via Route53 that is configurable in CloudFormation. The domain name can be provided if required. Obviously a AWS TLS1.3 PKI certificate is also required. * Behind the landing...

I'm in need of an AWS-savvy data engineer with a deep understanding of data transformation and integration. Key Requirements: - Expertise with AWS Glue: You'll be working extensively with AWS Glue, so prior experience with this service is essential. Knowledge of other AWS services like S3, EC2, and Lambda is a plus. - Data Transformation Skills: You will be responsible for transforming raw data into a usable format. Knowledge of best practices in this area is highly desirable. - CI/CD Pipeline Setup: Your assistance in setting up CI/CD pipelines using AWS CodePipeline is crucial for the project's success. Your tasks will include: 1. Utilizing AWS Glue for data transformation and integration. 2. Setting up CI/CD...

...and user states to handle queue redirects - Human Simulation : mimic human behavior to avoid detection (randomized request intervals) - Technical requirements - use session management and different proxies/ips, implement captcha solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliabl...

...expert who can leverage AWS S3 and Lambda for two specific use cases on our platform. Key responsibilities: - Designing a data storage and retrieval system utilizing AWS S3, ensuring data is organized, secure, and easily accessible. - Implementing a Lambda-based serverless computing solution to execute data retrieval operations efficiently. Skills and Experience: - Proven experience with AWS Bedrock, specifically S3 and Lambda. - Ability to develop scalable and reliable solutions, even if a fixed capacity is sufficient. - Understanding of data management and retrieval best practices. - Experience in implementing serverless computing is a plus. This project is ideal for a specialist who can deliver a robust, reliable, and cost-effective solut...

...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work in ...

...converged infrastructure, cloud solutions, Virtualization and datacenter modernatizatio and a knack for translating complex technical concepts into clear, concise writing? We're seeking a skilled freelancer to create informative papers on various aspects mentioned below The ideal candidate will possess the following qualifications: In-depth knowledge of leading HCI solutions: VMware vSAN, NSX, HCX, Azure Stack HCI, etc. Solid grasp of HCI architecture: Distributed storage, software-defined networking, and resource management. Experience deploying, configuring, and managing HCI clusters: Proven track record of hands-on experience.
 Cloud Platforms : Proficency in major cloud platform like Azure, AWS or GCP. 
Experience with cloud automation tools, and automating in...

I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.

...in need of an experienced Amazon Web Services (AWS) specialist who has an extensive knowledge in EC2, S3, and Lambda. I represent an AWS Reselling company and am seeking individuals and small to medium-sized firms actively using AWS to partner with us for the 2024 CRP program, which focuses on promoting AWS adoption. Through this program, you can earn rewards for launching new projects on AWS or for your existing active AWS projects. Increase your earnings effortlessly, without any additional workload. If you're interested in learning more, let's connect to discuss the details. Eligibility Criteria: The program is open to all IT companies, independent vendors, and freelancers supporting a diverse range o...

I am looking for a skilled Tensorflow expert who can perform image analysis on user-generated images. Specific requirements: - Retrieve data from AWS - Apply image analysis techniques on the fetched data - Focus specifically on face recognition within these images Ideal freelancer would have: - Solid hands-on experience with Tensorflow, AWS, S3 buckets and similar - Proven experience with image analysis, particularly face recognition - Familiarity with data retrieval from AWS This project requires precision and keen attention to detail, underscored by a profound understanding of image analysis. If you believe you can handle this task, I look forward to seeing your bid. An NDA will be required for additional further detail

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. ...

...I am in the process of migrating some websites from a cloud server to AWS. Seeking an experienced AWS expert to provide a couple of hours of verbal advice over a Zoom meeting. Requirements: Extensive experience with AWS, including EC2, S3, RDS, LightSail, Route53 and other AWS services. Proven track record of successfully migrating websites to AWS. Ability to provide clear, actionable advice and best practices for a smooth migration process. Strong communication skills to explain complex concepts in an easy-to-understand manner. Responsibilities: Share your experience and best practices for migrating websites to AWS. Answer any questions we may have regarding the migration process. Guide on optimizing our AWS setup fo...

I need assistance setting up a WordPress blog on Amazon EC2 for a new blog AWS Setup and Deployment: a new WordPress instance on AWS using Amazon Lightsail or EC2. the existing ThemeForest theme from Bluehost to AWS. Content and Design: the site content is primarily in Arabic, with some pages in English. advice for students on studying abroad. any unnecessary content. a minimalist design. 5. Set up menus, categories, and subcategories. Content Upload: images and articles in Arabic. all content is well-organized and properly formatted. SEO and Analytics: up a Google XML sitemap. Google Analytics. the site for SEO. Performance Optimization: caching solutions to improve site

...- Offer relevant advice - Schedule meetings - Perform any function that is currently possible for it to do verbally The AI chatbot should be compatible with Slack and eventually extend to all phone applications. The chatbot should integrate with a database. We could explore other data integration requirements during our discussions. Ideal applicants are those familiar with AI chatbot programming, Google Assistant integration, and broad-reaching app compatibility. Database integration knowledge is essential, with bonus points for those who can offer a variety of data integration possibilities. Please bid only if you are skilled in these areas and ready to collaborate on this task. 'm looking for a skilled freelancer to program an AI chatbot that integrates s...

Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promot...

...are looking for an experienced developer to automate the process of retrieving data from specific websites using CRM and CID numbers. The goal is to develop a script or tool that will: Look up Doctor's Specialization: Use CRM numbers to search on the website: CFM Doctors Search Extract doctor's information including their specialization. Look up Disease Descriptions: Use CID numbers to search on the website: MedicinaNet CID10 Search Extract the disease description. Deliverables: ( ) A script or tool that can take a list of CRM and CID numbers as input. Automate the search process on the specified websites. Extract the required data and compile it into an Excel file with separate sheets for doctors' information

...ser manejado en esa solución (también en Python). Debe ser desarrollado en python. Debe permitir que se integre a otra solución que tiene las claves. De preferencia, se interactúa en español. Se reciben sugerencias de como operar, lo anterior en cuando a como hacerlo con la aplicación en donde se integrará. Estamos abiertos a escuchar soluciones. La solución debe quedar operar operativa en aws. Dinámica de tecleo. La dinámica de tecleo, o biometría del tecleo, es la información de tiempo detallado que describe exactamente cuando cada tecla es presionada y soltada por una persona cuando escribe en un teclado de computadora. La dinámica de tecleo es una rama de la biometría que s...

...collecting contact information for recruitment companies specifically operating in Saudi Arabia. Those companies are NOT necessarily based inside Saudi Arabia, could be based anywhere in the world, but they recruit for companies/entities inside Saudi Arabia. Please note that I do not need recruitment people in certain sectors such as Oil, Gas, IT, Engineering, Aviation, Procurement, Transportation, Architecture and Finance. Everyone else is yes needed. Key Requirement: You will need to find the contact name, position, email and LinkedIn account for each and every recruitment/HR/Headhunting person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for...

I'm looking for a developer to create a Chrome extension that will communicate with a server. The extension should be able to: - Extract the first value from the first document that is loaded - Select the second value from the second document that is loaded The communication between the Chrome extension and the server should be seamless and efficient. The server should be able to receive and process the values extracted by the extension. Iam using a multiple AWS windows instances upto 16. So in every instance I use chrome Browser for my Business to customers daily. So I run a Extension in chrome for Auto click drop-down &radio button That extension developed by other freelancer So Every instance& chrome extension has to connect to the...

I'm looking for a developer to create a Chrome extension that will communicate with a server. The extension should be able to: - Extract the first value from the first document that is loaded - Select the second value from the second document that is loaded The communication between the Chrome extension and the server should be seamless and efficient. The server should be able to receive and process the values extracted by the extension. Iam using a multiple AWS windows instances upto 16. So in every instance I use chrome Browser for my Business to customers daily. So I run a Extension in chrome for Auto click drop-down &radio button That extension developed by other freelancer So Every instance& chrome extension has to connect to the...

Thumbnail for my monetized/commercial/personal use YouTube video

...capable of creating a logo for a small home-grown floral business. This logo will be utilized extensively across multiple platforms, including my website, print materials, and social media platforms. While certain designs might be welcomed, I do not have a specific color preference, leaving the artist with creative freedom in that regard. Ideal candidates for this project should have: - Ability to communicate and work efficiently with specific themes regarding floral design and script, custom fonts. - Understanding of branding across multiple platforms More specifically: I am in the process of starting a (super small) floral business, growing all my own flowers from my garden in Loveland, Colorado. I am a one-woman strong operation with a passion for gro...

Prosimo, vpišite se ali se prijavite za več podrobnosti.

Prosimo, vpišite se ali se prijavite za več podrobnosti.

I have a project where I need assistance with a few specific aspects of deploying node.js. These include: - Connecting to a PostgreSQL database that is currently partially set up, - Integrating with Sequelize, specifically addressing problems with model relationships, - Establishing a connection to AWS. This will be an hourly consultation, so I'm in need of a freelancer who is highly skilled in node.js deployment, PostgreSQL database set up, Sequelize integration, and AWS connections.

I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively

I need to Extract followers of group members of the link I will provide

I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would...

I'm in need of a knowledgeable Linux and AWS expert to assist me with various tasks related to command-line operations, system administration issues, and application support using AEM admin console. Key Requirements: - Strong command-line skills: You should be proficient in using the Linux command line for a variety of tasks. - System Administration: Experience in Linux system administration is essential, as I need assistance with file management, user management, and package management. - AWS Services: Familiarity with AWS services, particularly the AEM admin console, is a must. The ideal candidate for this role should possess a deep understanding of Linux, system administration, and AWS services to provide timely and effective job suppor...

I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.

... This platform will serve as a key component of my radio station's operations. We're looking for a developer with experience on building a DDEX distribution system where the user can upload the tracks and albums, images to distribute on different dsp sites like Spotify, Beatport, Apple Music, etc and receive music from our industry partners. With functionalities where the user can upload any format of track file like mp3, wav, flac so that it can be encoded into different formats and can be distributed to different dsp sites depending upon required formats. The administrator can upload the royalty files in different formats like xls, csv, txt. provided by dsp sites and calculate the revenues for the artists and label user’s earned by their distributed albu...

...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...

I'm looking for a seasoned NextJs & React developer to craft a high-performance, single-page website for desktop and mobile. Your expertise in responsive design is crucial to ensure seamless, optimal performance on both. Note:- Please check figma of layout required below. The key features I require include: - Fast loading - Google page speed check has to be 100% for both desktop and mobile - The page is image heavy, hence has to lazy load images correctly - Menu has drop down images heavy. Accordingly loading should be only on mouse over and not interfere with rest of page load. - First part

I need a script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Ne...scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js experts If you think you're the right person for this job, please get in touch with your relevant experience and a brief overview of your proposed approa...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you