Web scraping vs data mininglavori

...configurable) - API Integration: Price data will be expected to be sourced from a reliable API. - User will provide mandatory fields you need to call APIs ( contract-address, chain-id). - Most APIs have a rate limit of something like 120 calls/minute so you need to bundle and query multiple crypto into a single call. Most APIs allow upto 30 to be bundled in one call. - There can be any number of cryptocurrencies to track, anywhere from 10 to 10,000 - so it'd be important to bundle calls to respect the rate limit. Ideal Skills: - Experience with cryptocurrency API integrations (such as GeckoTerminal API, DexScreenerAPI, DexView API - any of those three) - A good understanding of cryptocurrencies and the difference between 'coin' and 'token' , price vs...

I'm in search of ...a skilled freelance developer who can build an efficient web scraper for multiple websites. Your primary responsibilities will involve: - Extracting text content from various websites, targeting important details - Outputting scraped data in a raw format to a CSV file This project requires: - A comprehensive understanding of web scraping tools and practices - Knowledge of data extraction and CSV files - Ability to work with multiple websites simultaneously - Experience in dealing with different website structures Please note that I do not require the data to be cleaned or organized. It should be delivered raw, exactly as scraped. This project is a great opportunity if you have experience in dealing with huge amoun...

...seeking a meticulous and SEO-savvy Content Specialist & Data Entry Freelancer to enrich our hand picked luxury villa directory. Your primary role will involve scrapping villa content, including descriptions, pricing, amenities, and images, and manually creating new property listings through our back office. You will play a crucial role in expanding our collection of exclusive properties, ensuring that each listing is engaging, - SEO-optimized, and aligns with our brand's high standards. Key Responsibilities: - Content Scraping & Data Entry: - Scrape villa content from various sources, ensuring the collection of comprehensive information including descriptions, pricing, list of amenities, and images. - Manually input the scraped data into our sy...

...and debug a piece of code for my data scraping project. The successful freelancer will need to have deep knowledge in not only JavaScript but also in how it interacts with Axiom AI. Specifically, the tasks for the job include: • Fixing the bug that causes the JavaScript code to crash during execution. This issue consistently occurs when executing on a specific website, and it's crucial that we solve this to ensure seamless scraping. • Improving robustness of the code so that it can handle website-specific peculiarities, making the scraping process interruption-free. Ideal Skills and Experience: • Profound knowledge and experience in JavaScript development. • Strong understanding and hands-on experience in Axiom AI. • Soli...

I am looking to hire a Python expert to develop a web scraping tool. This tool will be used to scrape data from Google Maps and several e-commerce websites. The ideal candidate should have the following skills and experience: - Strong Python programming skills - Experience in developing web scraping tools - Knowledge of working with different types of data, including text, image and tabular data **Host Websites** You'll be extracting data from Google Maps, along with diverse e-commerce sites. **Data Types** Diverse data needs to be scraped which includes text, image, and tabular data, spread across different pages and sections within the website. Please note, the exact specifics of the data to be ...

I am looking for an experienced Android app developer (who also knows xcode and ios) to create an informational app focused on scraping and presenting information from websites. My primary objective is to create an app that mimic the same function in my ios app. Key Aspects: - The app should display news updates in a scrolled list format, providing a seamless browsing experience. - It should be designed for optimal performance, ensuring swift loading of content. Ideal Freelancer: - Proven experience in Android app development. - Previous work on informational or news-related apps is a plus. - Strong knowledge of user interface and experience design, ensuring the app is intuitive and user-friendly. - Familiarity with optimizing app performance. - Excellent problem-solving skills, c...

...with expertise in Google Scripts and web scraping. Given my budget of $10, these are the key tasks I require: - Develop a Google script that efficiently fetches match winners for One Day International cricket matches from the 'World Cricket' website. Please note that this script should perform tasks automatically and populate the relevant details onto my Google sheet. The successful freelancer also needs to ensure that it is effective and doesn't breach any legal or ethical guidelines in accessing the website's data. The specific data I need are: - The official name of the match winner(s) The ideal freelancer for this project must show: - Proficiency in working with Google Scripts - Demonstrable experience in web scraping...

I am looking for meticulous freelancers who can accurately fill out a provided spreadsheet with detailed business data. This task requires manual effort and diligent research; automated web scraping is prohibited. A spreadsheet will be provided with a list of business names, locations and company website. I am missing information from the following fields that I need filled in: - Number of employees - Minimum spend or project size of their clients - CEO or Managing Director Name - Other key decision makers - Industry specialization (if applicable) There are 81 companies that need to be researched for the above data points on the spreadsheet. The data that needs to be sourced can be found by utilizing tools such as: - (free resource) - Google

I'm currently in need of a proficient Python programmer who is also experienced in MERN stack and particularly in machine learning applications. Your Responsibilities: - Work on data analysis with Python - Web scraping for data collection - Leverage your knowledge of machine learning to tackle unique tasks and problems As an Ideal Candidate, You Should Have: - Intermediate-level knowledge in machine learning techniques - Solid experience with MERN stack - Proficiency in Python - Proven problem-solving skills I am looking for someone who is available immediately and can devote dedicated time to complete the project. I am also interested in discussing longer-term collaboration opportunities. Please provide any relevant examples of your work when making a...

I am looking for a Python expert capable of undertaking a range of tasks. This role will involve tasks related to data analysis and visualization, web scraping and automation, as well as GUI development. Ideal Skills and Experience: - Extensive Python programming experience - Experience in data analysis and visualization - Experience with web scraping and automation - GUI development experience Issue there is a password protected network mapped drive where we need to write programatically using python

...brand engagement. Not so much the sports videos, it’s more the head to head animation in different sports environments. My goal here is to have a 3d video that is more a head to head battle. So this person vs this person. And the background will all be more animated sports themes. So helmets clashing or a football field, baseball field, basketball court. Head to head. Not so much actual videos but more settings and templates that are all animated. Obviously let the freelancer do what he does best to make it look engaging and thrilling but that’s the thought process. Like man vs robot with a cool background that is sports themed. Key Deliverables: - Developing content around sports betting and animation. This unique angle would be key in attracting and...

Hello! I needed a custom script to scrape TikTok followers. Was wondering if you can assist.

I require expert web scraping services for approximately 10,000 companies on GlassDoor. The purpose of this project is to evaluate company reputation by analyzing the employee reviews – full history. Extracted data will include: - Review texts - Star ratings - Employee positions - Recommendation status - CEO approval ratings - Business outlook ratings Ultimately, all the scraped data needs to be delivered in a CSV file format. The ideal candidate should: - Have extensive experience with web scraping particularly large volumes of data. - Have excellent attention to detail to ensure that all categories of information are extracted. - Understand data privacy and comply with all legal requirements during scraping process....

...solution for my web scraping needs. The task involves scraping text data from a single website and providing this data via a PHP API endpoint. Key details regarding the task include: 1. Data Type: The data to be scraped off the website of interest is primarily text. It is therefore a necessity that any interested freelancer has the required proficiency in processing and manipulating such data. 2. Scraping Destination: The webscraper should be designed to send all scraped data requests to a PHP API endpoint. This is meant to directly avail the data for my consumption. 3. Scale of Task: The task only involves data extraction from a single website. As such, it would not necessarily require the ability t...

I'm in need of an accomplished web scraper that can capture all tweets by a particular single user. This task requires fine attention to detail, thoroughness, and a firm knowledge of web scraping technologies. It involves: - Extracting all tweets from the user, including tweets where the user replied. - Not incorporating any retweets the user has made. Only source material from the user. - Not conducting any special keyword or hashtag filtering. Every single tweet (that isn't a retweet) is required. Although not obligatory, previous experience in Twitter's API would be beneficial. Please be prepared to discuss your process in the proposal. If you accomplish the goal, there might be more work of a similar nature in the future. Looking forward to hearing...

I need a gifted IT professional with proficiency in Prestashop and web scraping. The task at hand involves the copying and uploading of specific product information from another website to my Prestashop store. What I require includes: - Product descriptions - Product images - Product pricing - Product mini videos Rest assured, I have the necessary permissions to utilize these product details from the origin website. I'm hoping to have this project completed as soon as possible, so a quick turnaround time would be highly appreciated. Key Skills: - Prestashop expertise - Web scraping - Quick data entry - Efficient time management - Respect for intellectual property laws

I need a gifted IT professional with proficiency in Prestashop and web scraping. The task at hand involves the copying and uploading of specific product information from another website to my Prestashop store. What I require includes: - Product descriptions - Product images - Product pricing - Product mini videos Rest assured, I have the necessary permissions to utilize these product details from the origin website. I'm hoping to have this project completed as soon as possible, so a quick turnaround time would be highly appreciated. Key Skills: - Prestashop expertise - Web scraping - Quick data entry - Efficient time management - Respect for intellectual property laws

...need of a health researcher specializing in analyzing NHS data and identifying impact of interventions For my project, I require an expert who can help with NHS data. This includes: -A deep understanding of NHS data and how to interpret it effectively. -The ability to assess the impact of interventions within the healthcare industry using this data. -Skilled in statistical analysis, data mining, and trend analysis. The ideal candidate will offer invaluable insights on how interventions are affecting the health landscape, concrete evidence that can be used for strategic decisions. Prior experience working with NHS data and a background in health research would be highly beneficial. I am looking for someone who can dive into the data...

I am seeking a professional with experience in data extraction from mobile apps to develop a comprehensive scraper tool. The scraper will extract data from an app that offers both an Android and an iOS. The targeted data includes: - Ratings and reviews - User profiles - App content and descriptions From the ratings and reviews, we’re interested in extracting: - Individual review comments - Reviewer username The perfect candidate for this job will demonstrate the ability to deliver a solution that can navigate varying app structures and ensure high-quality, clean datasets. Proficiency in web scraping tools and understanding of either iOS or Android app structures are undoubtedly critical. Please provide a portfolio of relevant work when bidding.

...assistance with my Wordpress/Elementor website which is currently hosted on SiteGround. The website is not loading properly, displaying error messages, and having layout or design issues. To help you visualize, it seems like no content is being shown at all. I’m not entirely sure when this happened. I restored a backup from yesterday and it still looks the same. Attached photos of the site now vs the site before Key Issues: - Entire website malfunction: Critical error resulting in no content being visibly displayed. - Loading problems: The site fails to load correctly. - Error messages: Displaying error messages - Layout and design discrepancies: The site layout or design is scrambling. Ideal Skills Required: - Extensive knowledge of WordPress, - Proficiency in the ...

I'm in need of someone skilled in web content organization who can help consolidate all the content on my website into one well-structured document. Your mission will be to: * Thoroughly comb through the content on my website * Extract each piece of content and organize them according to their respective headings. First by Post Heading, then subheadings in each post. * Present the consolidated material in one neat, easy-to-navigate document. I will share a google document for this purpose. Please pay attention to diligent organization as it is crucial for this task. As such, prior experience in content structuring, web scraping, or a similar field would be advantageous. Attention to detail, exceptional organizational skills, and experience in using office soft...

...can handle this task. My budget is 15 USD 1. **Extract Data from Website:** The first script should serve the purpose of extracting data from a specific website. The precise website to extract data from wasn't mentioned but will be provided once we've established communication. I will also provide details on what specific data needs to be extracted. 2. **Limit Access:** The second script should be able to impose access limits. It wasn't clarified if the access limit is for a specific website, page, database or another entity. Details will be given when we start the project. **Ideal Skills:** The freelancer undertaking this job should have an in-depth understanding and knowledge of Google Scripts, Web Scraping, automation, a...

...Python programming languages, topics will be provided by us and how-to-write format will be provided by us. Ideal skills and experience for this job include: - Proficiency in Python - Good writing skills and the ability to explain complex programming concepts in a clear and concise manner - Ability to write engaging and informative blog articles - Proficiency in conducting research and presenting data analysis findings The articles should be well-researched, easy to understand, and provide practical insights and examples. If you have the required skills and experience in any programming and can deliver well-written blog articles within the specified length, please submit your proposal The following is desirable: * You are a member of Github, , or any other programming

I am seeking .NET developer I have Two projects in github repository I need to deploy these two projects in my visual studio project entity framework is used. I need to run those projects on vs code. Budget is fix 10$

...product prices across these websites. I will personally determine the list of supermarkets in scope. Ideal Skills: - Experience with web scraping: To effectively perform this job, you should have substantial experience in web scraping, as this will be the backbone of the search engine. - Proficiency in Python: The search engine or code should be implemented mainly in Python. Hence, proficiency in Python is highly important. Please note the following: - This is an experience-based project, so when applying, kindly highlight similar projects you have completed in the past that demonstrate your competencies for this job. Previous experience in building price scraping tools will be highly regarded. - With your application, I would appreciate it if ...

Some enhancement in Python Script

I'm looking for a freelancer who's great at web scraping to help with a project involving two specific websites initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provid...

I am in need of a skillful graphic designer who can help me put together a logo for our multi-sport league called Artists Vs DJs which includes basketball, flag football, kickball, and softball. Key Requirements: - The logo should give a nod to the various sports involved. - You have full creative freedom with the color scheme. Choose the colors you feel best fit the design. Your Expertise: - Proven experience in graphic design, ideally with a sports background. - Strong ability to represent multiple ideas (in this case, various sports) in a single cohesive design. - Excellent understanding of color theory and its application. Please include examples of sports logos or similar projects you've worked on in your bid. This will show your capacity to handle and succeed with thi...

I need a proficient freelancer who can compile an Excel-based mailing list that will aid my business in promoting its products and services. Key Features of the Mailing List: - It should include the client's name, email address, and location. - The list should be presented in an Excel format. Ideal Skills for the Job: - Experience in data collection or data mining. - Advanced skills in Excel. - Attention to detail to ensure accuracy of the data collected. - Knowledge of GDPR or other privacy legislation would be beneficial to safeguard client information. Your role will be integral in improving our business's product promotion strategies. List should be targeted to only CEO'S and Owners of companies, MAIN locations: USA, AUSTRALIA, CANADA, ...

...assistance with my Wordpress/Elementor website which is currently hosted on SiteGround. The website is not loading properly, displaying error messages, and having layout or design issues. To help you visualize, it seems like no content is being shown at all. I’m not entirely sure when this happened. I restored a backup from yesterday and it still looks the same. Attached photos of the site now vs the site before Key Issues: - Entire website malfunction: Critical error resulting in no content being visibly displayed. - Loading problems: The site fails to load correctly. - Error messages: Displaying error messages - Layout and design discrepancies: The site layout or design is scrambling. Ideal Skills Required: - Extensive knowledge of WordPress, - Proficiency in the ...

...help me collect delivery timeline data for various zipcodes from Amazon product pages. This project involves extensive web scraping and the ideal freelancer should have a proven track record in similar projects. Key Responsibilities: - Extract delivery timeline information for each specific Amazon product based on the provided zipcodes. - The product ASINs and zipcodes for which the data is required will be provided to you. - Handles large amounts of data and ensure its accurate collection. Ideal Skills and Experience: - Experience with web scraping, ideally Amazon product pages. - Proficiency in using Python to write scripts for data extraction. - Proficiency in using scraping tools or writing scripts for data ex...

...Octoparse, a leading web scraping tool. Tasks include: - Configuring the web scraping tasks: In particular, I require assistance with the set up of data fields to extract, managing pagination or navigation as well as handling dynamic content. Specifics will be given upon project assignment. - Troubleshooting: Address errors during the setup or scraping process and ensuring a seamless operation. - Automation: The setup needs to be automated to run on a schedule, integrate with other tools or platforms, and run when needed. - Exporting Data: Help me in understanding how to properly export the scraped data. The ideal person for this role has a good understanding of web scraping principles, a detailed knowledge of s...

I need reliable help with a data mining project focused on customer data. Key Tasks: - Skillful extraction and analysis of essential consumer information - Identification of significant patterns and correlations in the customer data set - Adequate interpretation of these insights to support business decisions Ideal Skills and Experience: - Proven experience in data mining, especially customer data - Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy - Adept at queries, report writing and presenting findings. Looking forward to your qualified proposals.

I'm seeking a developer with experience in API integration and web scraping to create a proof-of-concept application. The aim is to use the API Ninja Recipe API to generate an ingredients list, then cross-reference and scrape pricing data from for those ingredients, providing a total cost. Your tasks will include: - API integration - Web scraping - Complex data processing - Generating a UI to demonstrate functionality Ideal skills and experience: - In-depth understanding of API's, specifically the API Ninja Recipe API - Proven experience with web scraping - Ability to transform complex data into readable format - Experience with creating a usable UI Please note that though the question for freelancers to include ...

For this project, I am seeking an experienced data scraper to collect post URLs from Instagram. - The task requires navigating through 1000 Instagram URLs, of which the specifics will be shared upon project commencement. - The chosen freelancer must be adept in filtering the scraped data, specifically selecting posts within a certain date range and from specific niche accounts. - A solid understanding of Instagram’s layout and data structure is crucial to the success of this project. - The final result should be delivered in an Excel file. Ideal skills for this job are profound experience in data scraping, particularly on Instagram, and a proficiency in Excel for formatting the scraped data appropriately. Familiarity with Instagram...

I'm looking to extract specific information from , specifically: - Course Names - Course Durations - Course Codes - All Pricing d..., specifically: - Course Names - Course Durations - Course Codes - All Pricing details - Course Types - Course Provider Names & Locations I would require you to present the extracted data in CSV format. However, there is no need for you to clean or refine the data as I will handle that aspect myself. Ideal Skills & Experience: • Extensive experience in web scraping • Familiarity with the scraping of educational sites a plus • Proficient in data extraction and organization into CSV format • Excellent attention to detail, ensuring all the required data points are accurately capt...

...and include a brief explanation as why you gave yourself that rating: 1. Wordpress plugins 2. SEO experience 3. Javascript 4. Node.js 5. Angular 16 6. API development 7. HTML / CSS 8. PHP 9. Python 10. ERP systems 11. Tailwind 12. TaigaUI 13. Chrome Extensions (please rate yourself and provide any examples you might have) 14. Google Add-on 15. Keyword research tool 16. Web scripts 17. AI / ChatGPT experience 18. Web scraping Next, please answer these "get to know you" questions: Why are you interested in this job/project? What's your favorite stack? How many & what other projects are you currently working on? Do you work with a team, agency, or as an individual? Why should I choose you? How can you make it better or different than keywor...

Build me a python script that scrapes products

I'm in need of an email scraper to build and expand my email list. Currently, my method of collection is manual, which can prove to be quite time consuming. Key Requirements: 1....website link. 4. A sample work of the same project of 100 emails must be done for awarding of the project. 5. You have to complete the sample work in 1 hour. 6. Only interested and skilled freelancers must apply. Ideal skills and experiences: - Extensive experience in building or working with email scraping tools - Proficiency in Google Sheets or other spreadsheet software - Strong understanding of web crawling techniques and web data extraction - Solid background in data management and data cleaning This project will greatly improve the efficiency of building ...

...updates for an offline 3D game originally created with Unity. Here’s what I’m looking for: 1. **Additional Levels:** The game needs to grow as the player progresses. I want to increase the number of levels to keep it exciting and challenging. 2. **Enhanced Gameplay:** There’s always room for improvement. I seek enhancement to make the gaming experience smoother and more interactive. 3. **Player vs AI:** Let's add another dimension to this offline game. I'd like to introduce an AI mode where players can compete against computer-controlled characters. The updated version is intended for Android, so I need someone with experience optimizing for this platform. Ideal candidates should have a strong background in game development using Unity, solid...

...intraday, a new trade can be initiated if the price crosses back above todays signal (x) this is treated as a new trade. • Only 1 "trade" can be open at anyone time (consisting of the the (n) contracts). • I use an hourly timeframe for analysis, but the entries and exists must be at the defined values above (not the close of the bar. This is very important (as results will vary if I use a 5 min vs a 1 hour bar chart). • If I change the intraday timeframe from 1 hour to 5 mins (for a granular view of the chart), there should be no change to the strategy results, the strategy should function the same at 5 mins as 1 hour as the entry and exit values above are all fixed/absolute. Additional development work may be available pending the successful outcome...

I urgently require a robust and efficient email scraper to compile an extensive database of business emails from various websites. Thi...email scraper to compile an extensive database of business emails from various websites. This database will serve as a critical resource for my business operations, and as such, I need it as soon as possible. The ideal professional for this project should: - Have extensive experience in building email scrapers or relevant data extraction tools. - Be proficient in scraping websites quickly and accurately with minimal errors. - Understand privacy guidelines and ethical scraping practices. - Be able to scrape and deliver 100 emails as a sample project before getting selected for the project. - Be able to deliver the project promptly...

...Define tables for categories and any other relevant entities. 3. **Choose Technologies**: - Select appropriate technologies for building the website and managing the database. - Consider using a web framework like Django or Flask for the website, and a database management system like PostgreSQL or MongoDB for the database. 4. **Develop Data Ingestion Pipeline**: - Implement a data ingestion pipeline to continuously fetch new AI tools from various sources. - This pipeline could involve web scraping, integration with APIs, or manual data entry, depending on the availability of data sources. 5. **Implement Indexing and Categorization**: - Develop algorithms to automatically categorize new AI tools based on their attribut...

I require a savvy writer who's adept in crafting both technical reports and engaging blog articles on key aspects of mining, geared towards junior mining companies in Australia. Industry proficiency is highly crucial, with a strong emphasis on safety, mineral exploration, and environmental impacts. Given each article's breadth, an 800-1200 words count is deemed perfect. Favored skills include: * Comprehensive knowledge in mining * Proficient in technical and blog writing * Familiarity with Australian junior mining companies.

...to convert 70 Figma pages into a application while integrating Python web scraping bots, it is integral for me to hire a full-stack developer who exhibits extensive skills and experience in both frontend and backend development. Key Details: - Frontend: I require a developer well-versed in translating Figma designs into a functional application. - Backend: The chosen developer will need to seamlessly integrate Python web scraping bots. - Other Skills: Proficiency in NestJS, Fastify, PostgreSQL, and Python is a necessity. Deliverables: - The final product should be a cloud deployed application. - The project's backend should facilitate the smooth functioning of the Python web scraping bots. - The frontend, true to the origina...

>Registrati o accedi per visualizzare i dettagli.

...about clearances and effort - we mutually agree to effort - we assign you the task after mutually agreed - you implement, test and deliver - you provide also unit /integration tests to ensure code is always working - you document each required step to make interaction of systems to work - we test on our premise (you maybe help to fix issues) - we pay (basically the rules of freelancer) Closed book vs open book? We work only on open book. Closed book means you are unwilling to define a WBS for the work and you add only a price tag to the task. We are sorry we will not hire you in such a case! Deliveries? - in our on premise (access will be granted to you) - full sources - new plugins, need prior confirm and we prefer to use mostly latest stable versions - your changes are work...

...main function would be to systematically scrape data from Google Maps as well as various eCommerce platforms. While the exact data to be scrapped and the main purposes of doing so haven't been defined yet, I believe someone with the correct skills set would easily navigate through the process once those details are clarified. Additionally, you might be provided with a list of specific websites or regions or be asked to scrape from any website or region, details of which are currently undefined. Hence, adaptability will be a key trait for succeeding in this project. Ideal Skills: - Proficiency in Python - Experience using Scrapy, Beautiful Soup, and Selenium - Knowledge of Google Maps api, Telegram API, and WhatsApp API for data scraping purposes ...

...proficient developer to construct an API and website for downloading the master data of the latest companies from www.mca.gov.in. The API should allow the master data to be downloaded in a CSV format. Skills needed include API development, automation, and web scraping. Deliverables include: - A well-structured API for accessing and downloading the latest master data. - An intuitive dashboard to easily monitor the downloaded data. Experience in dashboard creation is necessary. The API should be able to fetch the following details from the master data: - Company Name and Address - Directors' Details - Shareholders' Details - Contact info - Email Strong understanding and experience with API development, data scraping...

I'm seeking experienced web scraping specialists to develop and execute a scraper for the Myntra website. This project involves gathering precise data about product prices and specifications from all categories on the site. Your responsibilities: - Develop a robust web scraper tool - Extract and deliver accurate product price data - Extract detailed product specifications - Ensure all categories at Myntra are thoroughly covered Ideal candidate: - Prior proven experience in web scraping - Excellent knowledge of python or similar programming language - Familiarity with Myntra or similar e-commerce websites A successful completion of this project would potentially lead to more web scraping tasks in the future.