How to detect web scrapinglavori

I have a few python scraping scripts that need fixing.

I'm seeking a data mining sp...diligently extract specific information about influencers and a targeted audience from web, especially from social media platforms. Here's what you'll be focusing on: - Influencers' Data: Collect substantial data regarding social media influencers. Capture data like social media followers, engagement metrics, contact details etc. - Target Audience Data: Analyze and mine information about the chosen target audience. Essential details include demographic information, engagement activity and the generation of a precise buyer persona. Social Media Platforms: - Instagram - Facebook - YouTube A strong understanding of these platforms and advanced data mining skills is critical for this job. Experience in data scraping and a...

I'm in need of a Python developer to create a script for my custom CRM. The aim is to efficiently scrape specific data fields totaling approximately 300,000 records. Primary duties include: - Scraping the following data fields: Name, Email, Phone number, Company name, Revenue, Address, SIC code, and Number of employees. - Ensuring script effectively handles duplicates by ignoring them, preventing data duplication within the record pool. Skills and Experience: - Proficiency in Python scripting is required - Prior experience with data scraping is essential - Familiarity with custom CRM platforms would be highly beneficial The ultimate goal of this project is to have a Python script that integrates seamlessly with my custom CRM, accurately and effect...

Seeking an expert with automation technology to submit a message to 1000 carefully selected websites' contact forms. This project demands an automated solution for locating contact pages, filling out, and submitting forms efficiently while ensuring high accuracy. Responsibilities: Automate the submission process for a list of 1000 URLs. Overcome anti-bot measures like CAPTCHAs. Provide a report categorizing submissions by success and failure. Requirements: Experience in automation, web scraping, and CAPTCHA-solving. Proficiency in relevant programming and automation tools. Ability to deliver a detailed submission report. This opportunity will open the door to ongoing projects, as we value precision over quantity, focusing on a curated list...

...downloads people can upload to their own Wordpress site(s). Examples might include: A Wordpress plugin that talks to our SAAS, receives articles and places them into draft mode on a Wordpress site. A Wordpress plugin that tells the user in their dashboard how many words are on a post, among other analytics. A Chrome extension that scans a page and tells a person if they are missing any <h> headings in a post. A PayPal calculator type of tool embedded in our Wordpress site that people can use to see how the fees affect the amount they want to send / receive. Looking to hire someone that can build these types of tools on a daily & ongoing basis. Should be experienced & familiar with building Wordpress plugins & on...

...individual looking to extensively explore Website A's content, I'm in need of an adept coder who can accurately scrape data for me. The task might seem enormous, but it's all about gathering specific sets of information. They include: - User data - Product data - All chapters: detail-oriented individuals should ensure no chapter is left out. - All sections: I expect a perfect scrape of all available sections. - Resources: every resource available on each course offered should be comprehensively retrieved. - All downloads: I'm interested in all downloadable tools or files present on each course. Successfully completing this task requires not just any coder, but one with vast experience in data scraping. The ideal bidder should also possess an acute a...

...a bit tedious and requires me to manually enter 18 pieces of data for each prediction. I'd like this to become more streamlined. My requirement is for the code to be adjusted to the point where I can simply enter the names of the home and away teams and get a prediction. Scraping from external websites will be necessary for this project, specifically from and soccerstats.com. The ideal candidate: - Has strong Python coding skills - Has excellent experience and knowledge in sports analytics - Has experience with data scraping and can navigate around potential roadblocks - Is familiar with libraries that may assist in achieving the goal. This enhancement to my existing codebase will significantly reduce the time and effort requir...

>Registrati o accedi per visualizzare i dettagli.

...expert C# developer who can undertake a web scraping project for me. Though I haven't specified which websites to be scraped, you should be prepared to scrape diverse websites. The exact data to be extracted is not stated explicitly. Be ready, however, to scrape multiple forms of data including text content, images, and tables. *Skills & Experience Required:* - Proficiency in C# development - Extensive knowledge and practice in web scraping - Ability to scrape diverse forms of data (text, images, tables) - Familiarity with Scrapy, BeautifulSoup, Selenium, or other relevant web scraping tools is beneficial Please note that I have not mentioned a particular web scraping tool or f...

Seeking a skilled C# developer to handle a web scraping project. Unfortunately, as I haven't specified the data or websites to scrape, you'll need the verve to work with a variety of sources. I'd potentially need text content, images and tables lifted but also might want entire pages scraped. The ideal freelancer for this project is versatile and adaptive, possessing strong C# coding skills and extensive experience in web scraping. If you're comfortable working with uncertainty and developing versatile, robust scraping solutions, I welcome your bid.

I am seeking the assi...am seeking the assistance of an adept developer to collect specific information from the Mturk platform. * We Majorly need to extract worker ratings and qualifications. * The collected data should be formatted and organized in a text file, where each line represents a worker's rating and qualification. Your expertise in web scraping is fundamental in this project. Experience in platforms similar to Mturk is an added advantage. Although I didn't specify the programming language, your recommendation and expertise in the most effective and efficient language/software will be highly considered. Please make sure your proposed language/tool is highly efficient in handling such type of data extraction and formatting. I a...

...cutting-edge system designed to capture and analyze real-time video data from streaming cameras. Our current setup attempts to connect the camera and software using OpenCV and an RTSP protocol, but this has not been successful. The primary issue lies in integrating WiFi camera streams into our system efficiently and reliably. Scope of Work: We are seeking a skilled freelancer to develop a Python script that can: Detect IP Address of the camera Accept an IP address as input for any WiFi camera. Establish a connection to the WiFi camera using the provided IP address. Read and capture the video stream from the connected WiFi camera. Ensure compatibility with RTSP protocols and seamless integration with OpenCV for further processing of the video stream....

Tasked with collecting detailed information about restaurants in Cologne, I'm looking for an expert in data scraping who can help me with this. - The data collected should include the restaurant names and their contact information - both phone numbers and email addresses. - After sourcing this information, it should be organized neatly into an Excel file. Preference is for each type of data to be in separate columns – one for the restaurant name, one for the phone number, and one for the email address. Qualifications: - Proven experience in data scraping - Attention to detail - Proficiency in Excel - Familiarity with the restaurant industry might be a plus.

I require a capable web scraper to continuously gather sports betting odds and live scores from bet365.com. This will be an ongoing project with data required to be scraped live as it updates on the site. The main details required are: - Sports betting odds - Live scores The project requires: - Proven experience in building real-time web scraping systems - Good understanding of sport betting websites, especially - Proficiency in python programming would be beneficial - Excellent attention to detail to ensure data accuracy Please note, the data needs to be scraped live. Therefore, your proposal should include how you plan to ensure the continuous and timely data extraction.

I want to develop an algorithm for drowning person detection using yolov8n, yolov8s, yolov8m, yolov8l, yolov8nx detect the drowning person and detect the results I will provide you with the annotated dataset

...with common scraping tools and methodologies. - Proven experience in web scraping. - Attention to detail for collecting accurate data. The objective of this project is to use the retrieved data for research purposes. Therefore, precision in data collection is paramount. There is no requirement for image or price scraping, purely text-based material from these sites. Key Project Components: - Scrape text content from Website 1 & Website 2. - Ensure the accuracy of the collected data. - Clean and structure the scraped data properly for easy analysis. You will be scrapping data from Website 1 and 2, updating the excel sheet with the required information and inputting which website has either the most recent data or if both the same. I wi...

Looking for a person who will make quality work of scraping html adresses from specific websites I will list. Rarely manual work, 80% automated with the use of addon programs for chrome.

I'm looking to have a system setup to automatically import newly added cryptocurrencies from both Coingecko and Coinmarketcap directly into Google Sheets every 15 minutes. I'm interested in not just the price, market cap and volume of these coins, but all available data fields. Key Requirements: - The system must scrape Coingecko and Coinmarketcap for newly added coins - All available data fields of the coins should be imported into Google Sheets - The data should be refreshed every 15 minutes automatically Skills & Experience: - Extensive experience with web scraping - Prior work with cryptocurrency data is a plus - Familiarity with Google Sheets integration is a must - Knowledge of APIs is desirable, but it's important to note ...

...data scraping code tailored to extract specific details from Website 1. This job involves the precise scrapping of restaurant information, inclusive of names, addresses, and contact numbers, to be saved in a CSV format for easy referencing and analysis. The essential deliverables for this project are: - Python code for scraping the specified data - Guidance on how to set up the code on my system - Collected data presented in a CSV file format The ideal freelancer for this job should have: - Extensive experience with Python and web scraping - Understanding the structure of Website 1 and how to navigate through it - Familiarity with setting up Python code on a client’s system - Experience working with data pr...

I would like to extrapolate the agents' data (name, surname, agency name, city/state, email, telephone) to csv from the url https://www.virtuoso.com/advisors#CurrentPage=1&FacetCategoryIndex=0&FacetLimit=6&LeftToShow=0&RowsPerPage=25&SearchView=1col&SelectedFacets% 5B0%5D%5BCategory%5D=advisor_specilty_destination_for_facet&SelectedFacets%5B0%5D%5 BCategoryLogicalOperator%5D=AND&SelectedFacets%5B0% 5D%5BName%5D=Italy&SelectedFacets%5B0%5D%5BDisplayName%5D=Italy&SelectedFacets%5B 0%5D%5BSelected%5D=true&StartRow= 0&SearchType=Advisor&SortType=LeadGenDescends and subsequent pages (about 4258 items)

eBay item ID's copy bot needed with ability to export details in XLM or CSV file Skills and experience needed: - Proven experience in coding software or bots, particularly in data scraping - In-depth understanding of how eBay works, specifically how item listings and their unique IDs are structured - Attention to detail: the scraped IDs must be accurate - Ability to work quickly: the tool must be able to handle relatively large volumes of data and bulk scraping.

As an online retailer, I'm searching for a Python developer who specializes in automation scripting. The specific task at han...retailer, I'm searching for a Python developer who specializes in automation scripting. The specific task at hand involves creating and refining web scraping scripts. The aim of this endeavor is to gather product details from various e-commerce sites. A strong candidate should have: * Proven experience and deep expertise in Python * Specific experience in scripting for web scraping * Familiarity with various e-commerce sites and understanding of their data points * Ability to organize the scraped data efficiently This project promises to be exciting as it adds meaningful value to my business. G...

Hello we have plant list name. We want to generate content from website scrapping and add it correctly to our sheet

Scrap data - Specific data to scrape: Contact Details - Desired format for the scraped data: - Table in MS Access Skills and experience needed: - Proficiency in data scraping from Android apps And web. - Expertise in converting scraped data into MS Access format

I'm looking for a deft hand in web scraping to extract data from approximately 15,000 Quora answer URLs. My aim is to extract the share count for each of these answers. This forms a crucial part of my research. These counts will aid me in tracking specifically the "how many times each answer shares" criterion. Only this specific data is needed for each answer. Key requisites for the freelancer includes: - Proven experience in web scraping - Familiarity with Quora's structure - Ability to deliver accurate, clean data rapidly My time frame is extremely tight as I'm needing this completed ASAP. Bid with confidence if you meet the required skills and can deliver in a swift manner.

...developer to address two critical issues with our existing scripts, ensuring they function seamlessly on a VPS environment and enhance our data handling capabilities: - **First Issue:** Update the Chrome driver on our VPS to match the necessary compatibility with our Python scraping scripts. This task requires familiarity with both Python scripting for web scraping and the configuration of Chrome drivers on a VPS. - **Second Issue:** Modify the scripts to save the output directly into a database instead of exporting it as a .csv file. This will involve integrating database management commands into the Python code. **Ideal Skills and Experience:** - Strong expertise in Python, with a focus on web scraping and automation scripts...

I am in need of a skilled Python programmer to execute two pre-written scripts to scrape textual data from two specific websites. Prior experience with web scraping is highly desirable. Your tasks include: - Running the Python scripts on both the specified websites. - Ensuring the accurate extraction of text data during the scrape - Formatting and presenting the extracted data in a CSV file Please ensure you can handle multi-website scraping before placing a bid. Success in this job could lead to other similar and future projects.

...in Selenium web scraping to assist with optimizing and enhancing our current web scraping project. This project involves collecting data from 3 specific websites for personal use, with a focus on improving speed and efficiency. The ideal candidate will have a strong background in web scraping, a deep understanding of Python and Selenium, and the ability to implement cost-effective solutions for running web scraping tasks. Responsibilities: Review and optimize existing Python Selenium web scraping scripts to improve speed and efficiency. Implement headless browsing, and optimize browser settings to disable unnecessary elements such as images and JavaScript for faster page loads. Introduce e...

This project is to create an outline for the Book about " How Childhood exposure affects one's life?"

...functionalities like data scraping and integration with web services. - This extension must scrape image + video data from a variety of popular web platforms such as Amazon, TikTok, Instagram, Facebook, Etsy, Google, Pinterest, and AliExpress. - The type of data to gather includes product details, social media posts, and search results. - Your understanding of how these platforms function and how their data is structured will be critical for this project's success. - Your expertise should cover designing and implementing customizable settings, ensuring the extension can be tailored to individual user needs. As an ideal candidate, you should have prior experience in similar project undertakings, a deep knowledge of Chrome extens...

A Brief statement which clearly defines how the manager assigns and supervises the work of their direct reports. I will share the existing resume and Responsibilities. You need to elaborate this more and add more technical vocabulary and wording. At the end I need A Brief statement which clearly defines how the manager assigns and supervises the work of their direct reports.

I'm in need of a skilled Node.js and devel... developer with a minimum of 3 years of experience in Puppeteer, WebRTC, and FFmpeg. The project is expected to be completed swiftly, given its urgent nature. Tasks to be performed include: - Puppeteer scripting: You'll be expected to help with data scraping. - WebRTC implementation: Real-time communication needs to be set up in the project. - FFmpeg integration: We have audio and video processing tasks that FFmpeg expertise could conveniently solve. Moreover, Linux familiarity is required. Ideal candidates should have a solid track record in using these technologies, ability to deliver on time, and a sound understanding of the Linux operating software. I look forward to seeing your ...

I’m looking to create a twitter scraping tool in either Python (potentially using BeautifulSoup & Tweepy) or Javascript. Must run on a set schedule (once a minute), Must use the twitter free api plan. If the free api plan caps it to >1min then multiple twitter api accounts are to be used to circumvent this rate limit. Check if any of the account list (hard coded list) have published a new tweet. If so: - parse the tweet searching for some characters preceded by a ‘$’ symbol and store it in a separate variable called TICKER. - parse the tweet searching for a word with a minimum of four characters & a maximum of 8 characters that are all in capital letters (not preceded by a $) and if found store it in a variable called P...

Good day to you, I am in need of an experienced data gatherer to get the following data for me. You will need to gather information on businesses in the following location and following categories: ~Locations in Cambodia~ [tag(s) to use for each] Phnom Penh [phnom penh] Siem Reap [siem reap] Sihanoukville [sihanoukville] Kampot [kampot] Kep [kep] ~Business Categories~ [tag(s) to use for each] Cafes [cafe], [food] Restaurants [restaurant], [food] Bars [bar], [drink] Hotels [hotel], [accommodation] Homestays [homestay], [accommodation] Tour Providers/ Operators [tour] Car Hire [car hire] Scooter/ motorbike Hire [scooter hire] Bicycle Hire [bicycle hire] I need the following details for each business: Business name Business Address Phone number ...

as discussed ..........as discussed as discussed as discussed as discussed as discussed as discussed

>Registrati o accedi per visualizzare i dettagli.

>Registrati o accedi per visualizzare i dettagli.

I require an adept web scraping developer proficient in extracting specific data, such as text content, images, and contact information from a websites. This task needs to be performed only once but within a strict time-frame of one week. The ideal candidate for this project should possess: - Experience in web scraping and data extraction - Excellent problem-solving skills to navigate through complex websites - Ability to deliver quality work under tight deadlines Please submit your proposals detailing your web scraping methodology and previous experience in this field.

I am looking for an expert in data scraping or collection, who can efficiently generate a database of international student contact information across US colleges and universities. This is not limited to just undergraduates but also those on a graduate level. The purpose of gathering this data is for marketing outreach. The database should include the following details: - Name of international student - Country of origin - School name where they are attending - Major or field of study Contact information required: - Email addresses - Phone numbers - Social media profiles Ideal candidates for this project would have experience in both data collection and understanding of privacy laws to ensure the information is collected legally. A knowledge in education systems a...

...freelancer to assist with a data scraping project involving extracting information from a handbook. The handbook consists of 37 chapters, with each chapter containing approximately 36 sections (pages) of data that need to be scraped. Project Details: Scope: Extracting data from a handbook consisting of 37 chapters, each containing approximately 36 sections (pages). Task: Scraping data from each section and transferring it to a Google Doc. Hangbook: Instructions: Deliverables: A Google Doc containing all the scraped data organized according to the chapters and sections of the handbook. Requirements: Experience: Prior experience with web scraping

...Skills & Qualifications:** - Profound knowledge of the HackerOne platform. - Proven experience with vulnerability assessment in different environments. - Exceptional ability in creating detailed, clear, and concise reports. **Focus Areas:** - **Web Applications:** To detect and exploit vulnerabilities within our web applications. - **Network Infrastructure:** Assess and recommend improvements for our network security. - **Mobile Applications:** Identify security flaws in our mobile apps. **Objectives:** - **Identify Potential Vulnerabilities:** To uncover any security vulnerabilities that could be exploited by attackers. - **Assess Security Controls & Measures:** Evaluate our current security measures and suggest necessary enhancements. - **V...

El objetivo: extraer artículos de noticias de sitios web específicos, según la consulta de búsqueda del usuario. El código debe estar SECO y estar escrito en módulos autónomos. Qué le podemos ofrecer -------------------------- 1. Oportunidades para trabajar con clientes externos famosos (p. ej., Disney, Ernst & Young, Credit Suisse) Puede elegir el contrato que trabaje para usted sin política, estrés o drama. Gestionamos todo eso por ti. 2. Múltiples oportunidades de proyectos internos Conviértase en nuestro proveedor preferido a largo plazo. Le ofrecemos proyectos que coinciden con su conjunto de habilidades e intereses. 3. Gran ambiente de trabajo Sea bienvenido a nuestro entorno familiar fe...

>Registrati o accedi per visualizzare i dettagli.

I am seeking a freelancer to create a utility that will operate on a Windows PC. This utility's primary function is to perform a screen scrape of , specifically focusing on the Market Depth page. The extracted text data will need to be organized and saved into a CSV file format for further analysis. **Core Requirements:** - Develop a Windows-compatible utility. - Automate login to access stockwatch.com. - Scrape data specifically from the Market Depth page. - Output the scraped data in a CSV file. **Ideal Skills and Experience:** - Proficiency in programming languages suitable for developing Windows utilities (e.g., Python, C#). - Strong experience with web scraping techniques and tools. - Familiarity with handling login sessions programmati...

I'm seeking an expert to systematically collect data from LinkedIn's personal profiles. The purpose of this project is to accumulate a detailed dataset including the following information: - Contact information - Work history - Education background - Skills - Awards At this stage, it remains unclear whether profiles that are not publicly visible will be included in the scraping process. This will be confirmed at a later date. The ideal candidate for this project should be experienced in data mining, preferably with prior experience with LinkedIn data. Familiarity with working within legal and ethical guidelines in data collection is a must due to the sensitive nature of some of the data involved.

...monitoring of prices on various e-commerce platforms. The ultimate goal here is to streamline my operations to gather competitive pricing data for analysis, which is crucial for my business strategy. However, I've hit a snag with captcha interruptions, severely affecting the efficiency of my scraping script. Here's what I'm looking for in a freelancer to tackle this issue: - **Integration of Captcha Solver:** Since I'm not using any specific captcha solving service yet, I need an expert to recommend and integrate an efficient, cost-effective captcha solving solution into my current script. This integration should seamlessly bypass captchas without manual intervention. - **Script Optimization:** The script needs to run once ...

I am immediately in need of an expert in data scraping, specifically barcodes, to assist with crucial product research. The target products have not been specified, so versatility in handling various categories is key. I need script where i could enter seller url like this one: Then the script should scrap all his uploaded product EANS, ean could easily found on source code of the Product. Example: productBarcode":"3763467994596 The page does not have much security, so should be pretty simple. Remember, i need script, to be able to scrap the products EANS myself from different sellers shops in this site.

I need manual scraping of executives and one specification sales rep for lighting agencies. I will provide you with a link to a website that has all the agency names, and you will follow my directions to ignore certain agency companies, and ignore certain territories. I will need up to four executive-level email addresses per company (president, partner, principal), and one specification sales person's email address. Important: Do not do automated scrapes, or you will not be paid. This must be manual, following my exact instructions. I will pay US $0.20 per email address. This project will earn you more than the stated amount of $100 Watch video to show you how to search, and more importantly, which companies to ignore, a...

>Registrati o accedi per visualizzare i dettagli.

I'm searching for an adept freelancer with experience in Python and Selenium to develop a scraper for automation purposes. Key aspects: - The main task will be web scraping to automate the extraction of product descriptions. - The scraper should be designed to handle English language only. Ideal candidate: - Familiarity with Python and Selenium - Experience in developing web scraping tools. Efficiency in handling this task is essential and will be highly regarded. The expectation is for this project to be completed in timely manner. Please ensure you have the required skills and experience before placing a bid.