Web data crawler website parsing web parselavori

In base alle specifiche ricevuto propongo di dividere il lavoro in tre milestone: - Lettura dati: il SW legge dati da seriale ed effettua il parsing estraendo le informazioni desiderate - Archiviazione: il SW memorizza i dati in formato mseed e struttura folder sds con una frequenza impostabile (come parametro all'avvio o in un file di configurazione) - Visualizzazione: lo stesso SW avvia una GUI che permette di visualizzare il segnale, scegliendo un periodo memorizzato o real time SW sviluppato in python con libreria tkinter per la parte GUI. Test effettuato su raspberry messo a disposizione dall'employer

Buongiorno, vorrei creare sul mio sito una pagina/motore di ricerca che cerchi tramite campo di ricerca, un prodotto su 4/5 siti specifici. Una versione semplificata di trovaprezzi. Dato il nome dell'oggetto da cercare mi fa vedere un grafico dell'andamento dei prezzi nel tempo, e il prezzo del prodotto nei 4 siti indicati. Tutto cio aiuta l'utente finale a capire se è un buon momento per acquistare. Non mi servono affiliazioni etc... una semplice ricerca con estrapolazione dei dati. Cerco una stampante marca e modello xyz, mi fa vedere il grafico del costo del prodotto nel tempo, e il prezzo in questo momento sui 4 siti indicati. Sul sito A costa 10 sul sito B costa 8 e cosi via.

Ho bisogno di realizzare un crawler che acceda ad un sito mediante login (credenziali salvate, no captcha) e acceda ad una determinata sezione del sito e recuperi i dati di alcuni clienti (cognome, nome, telefono, email, ed altre 3/4 informazioni) e li scriva in un db. per la scrittura nel db forniamo noi una pagina web che questo programma chiamerà passando i parametri (cognome, nome etc, attraverso post) e la pagina provvedera ad inserirli fisicamente nel db e restituirà (de definire in che modo insieme a chi farà il programma) l'esito dell'operazione.

Si necessità di consulenza per la predisposizione/configurazione del modulo di fatturazione per la fatturazione elettronica. Il gestionale è sviluppato in ReactJS per la parte front-end e Parse Server (NodeJS e MongoDB) per la parte backend. Il framework grafico utilizzato è Material UI. Pagamenti eseguiti su milestone dopo accettazione del progetto.

Si ha la necessità di realizzare un componente ReactJS da integrare in un gestionale sviluppato in ReactJS per la parte front-end e Parse Server (NodeJS e MongoDB) per la parte backend. Il componente deve dare la possibilità di: SI devono poter creare più magazzini virtuali (persone, mezzi possono diventare magazzini virtuali) collegati al magazzino principale per le attività di carico e scarico della merce. Il framework grafico utilizzato è Material UI. Il componente in questione deve essere perfettamente integrabile nel progetto esistente e non deve essere ulteriormente modificato.

Salve, utilizziamo un sofware server/client QZ Tray 2.0 che ci consentiva di stampare file remoti su una stampante locale Zebra. Purtroppo da ieri non funziona più, riceviamo il messaggio di errore: Cannot parse file. Vorremmo che venisse ristabilita la funzionalità della stampa del file remoto.

...permessi legati ad ogni attività (agenzie che vedono solo le proprie prenotazioni e così via) - API per integrazioni esterne/app - Sistema interno per sincronizzazione tariffe/disponibilità Per quanto riguarda la parte relativa ai prezzi/tariffe delle singole strutture, è assolutamente improponibile fare il parsing html di ogni sito, dato che ogni struttura ha la sua piattaforma di prenotazione e il proprio sito, e, seppur qualcuno usa piattaforme simili o uguali, comunque il parsing sarebbe davvero molto complesso, oltre al fatto che potrebbe smettere di funzionare alla prima modifica al sito della struttura. Per aggiornare prezzi/tariffe bisogna prendere accordi con le singole strutture e farsi fornire API per la comunicazione/verifica...

Semplice applicazione stand-alone per estrarre dal relativo database le fatture (già) emesse con un software gestionale preesistente e generare un file XML per ciascun documento, rispettando la formattazione prevista dall’Agenzia delle Entrate in ...2) In aggiunta a quanto descritto nel paragrafo precedente, si dovrà integrare un client di posta elettronica (MS Office) per: a. Inviare una pec all’Agenzia delle Entrate con i files XML delle fatture emesse come allegati; b. Intercettare le email ricevute dall’ Agenzia delle Entrate, come risposte alle email con gli allegati di fatturazione ed analizzarne i messaggi restituiti. La funzione di parsing così eseguita permetterà di aggiornare il database delle fatture già trattate per va...

Utopos è un’applicazione mobile iOS che permette di ascoltare brevi audio storie narranti la vita di personaggi storici famosi. Questa versione dell’applicaz...altre schermate, come Apple Music o Spotify. In questa versione ogni racconto sarà gratuito per cui non serve in-app purchase. Sarà necessario però un sistema di download dei file che vanno mantenuti poi in locale, in modo che l’utente possa scaricare e ascoltare la storia quando vuole. Il backend sarà molto semplice e andrà definito insieme. Nella scorsa versione avevo usato Parse. C’è una versione gratuita di Parse con un servizio che si chiama Back4App (). Altrimenti potremmo usare un servizio di Firebase o altro. Anche GraphCMS sembra molto p...

Buongiorno, Sono un rivenditore di prodotti elettronici ed attualmente vendo prodotti da diversi csv tedeschi. Ho un grosso progetto da sviluppare, ovvero prelevare con qualche sistema Crawler o simile un csv dal sito che ha degli ottimi prezzi ma non vende all'estero come altri, in pratica non è un b2b. Dispone solo di codici produttori che però grazie ai miei listini csv di altri fornitori possono essere in parte convertiti in EAN e quindi essere poi rivenduto su Marketplace come Amazone ecc. Quello che mi serve è creare il csv ed aggiornarlo tutti i giorni logicamente. Attendo Riscontro Cordiali Saluti Massimo Burlando

L'app deve essere in grado di eseguire un parsing dati da database e alimentare una list view di immagini. Le immagini sono iterative e portano a una schermata in cui a seguito di altre eventuali interazioni è richiesta la scrittura su database. Si richiede inoltre geolocalizzazione e mapping. Tutto è descritto in apposite BBP a cui fare riferimento

Un Applicazione in grado di aggiornare una list view da server,che permetta l'interazione con gli elementi della list view,con funzione di geolocalizzazione e mapping e che in seguito ad alcune interazioni possa scrivere su server. Necessità di costruzione database e parsing dallo stesso.

Progetto di marketing , esportare il brand Inglese in un'altra parse

Il progetto consiste nel creare una dashboard che si basa su Parse.com. Tutto il Cloud Code è fatto e l'app client iOS anche. Semplicemente integrare Parse (che è un fork di Backbone) in un template a scelta che magari si conosce già (tipo ), quindi gestione utente, creazione di nuovi item, gestione recensioni e cronologia.

craiglist phone number scrapper

Un web crawler che partendo da uno o piu URI scarica le relative pagine e fa lo stesso per i link contenuti nelle pagine scaricate (maggiori info nel package)

Salve. Cerco qualcuno che programmi un SEMPLICE (MOLTO SEMPLICE) Bot web crawler per un motore di ricerca (il motore di ricerca sarà per un sito interno, quindi non deve ricercare tutte le pagine del web)

I need automatic parser / one per 24 hour/ to parse a site and create csv or xml file for import to eshop magento Descrizione Progetto: vorrei importare i prodotti dal sito nel mio sito, ho bisogno di un file .csv collegato al mio sito che inserisca i prodotti e li aggiorni ogni 24 ore e che inserisca i prezzi in euro

...seeking a skilled freelancer to automate the process of sending student data to school coordinators via WhatsApp. The task involves parsing a large Excel sheet containing student data, splitting it into smaller sheets based on schools, and sending each school's data to the corresponding coordinator's WhatsApp number. The main tasks include: Data Parsing: The freelancer will need to parse the provided Excel sheet containing student data. The data includes student names, grades, schools, coordinator names, coordinator WhatsApp numbers, and student codes. Data Splitting: The freelancer will develop a Python script to split the large Excel sheet into smaller sheets based on schools. Each smaller sheet should c...

Looking for a Google Cloud Platform (GCP) expert who can assist with Cloud Functions and Vision API integration and deploy function on google cloud - Your main fo...google cloud - Your main focus will be integrating Vision API for images batch processing and setting up Cloud Functions. The urls of images will be in excel file in google cloud. The parse result to be placed in columns next to url column. - The data primarily processed with text detection. Ideal Candidate: - Proficient in GCP services, specifically Cloud Functions and Vision API. - Experienced in setting up GCP services for one function. - Skilled in implementing Vision API for image processing. - Strong understanding of data processing in GCP.

Mail server is getting attacked, I need to create a windows service constantly checking a .txt log file for preset keywords like "Failed SMTP login" or "Relay attempt" to auto block IP's. This service should auto add/de...example or a similar concept could be found here: Some of the settings that I need to control: – Duration to ban ip address (min) – Number of failed login attempts before ban – Whitelist of comma separated ip addresses to never ban – Blacklist of comma separated ip addresses to always ban – Custom keywords, XPath and Regex to parse logs for failed login attempts – No need to restart the service when we change settings – Highly configurable, ban anything that comes through a log file.

I'm in the process of developing a strategic web game that supports a large number of players, well over 100. Detailed features are documented but at a high level, it should support: - A player ranking system ensuring a competitive, and immersive experience. - Potential for future expansion, as there could be more game features to implement in the future. The ideal candidate for this project should have: - Extensive experience in multiplayer game development. - Knowledge of web game development and scaling to support 100+ simultaneous players. - An understanding of implementing player ranking systems. - Ability to parse and execute requirements from provided documents. The main goal is to build a world where gamers can test their strategic capabilities on a l...

I am keen to have a state-of-the-art AI Job Portal named '' developed, aimed to cater to job seekers around the globe. Key Features & Functionalities: - AI Job Matching: Primarily the porta...following: - Match jobs based on user preferences. - Suggest jobs according to the user's activity. - Recommend jobs adeptly considering user's skills. Given these functionalities, the ideal candidate for this project should possess expertise in AI and machine learning, must possess extensive experience in software development specifically for job portals. Familiarity with NLP to parse and scan resumes would be an added advantage. Our core objective is to save time and resources, hence efficiency and cost-effectiveness is essentially required in the comp...

I need a skilled python developer to create a JSON to Excel converter. Key Requirements: - You'll be working with Flat JSON data - How to handle missing data is up to you - Mapping of JSON fields to Excel columns is flexible Ideal Skills: - Proficient in Python - Experience with JSON parsing - Excel manipulation skills I'm open to suggestions on the best way to map the data, so please include your ideas in your bid. Let me know if you have any questions.

I am seeking an expert capable of creating a highly detailed and intricate graphic line art rendition of a lattice boom crawler crane with a luffing jib (two independently controlled booms). This rendition must strictly capture the exterior features of the equipment ( there's a lot). Your focus should also be on all the components that make up the crane. I am open to starting with a more basic line art (outline) and seeing what we need to add. This would be the first design for a construction apparel line You need to have a meticulous eye for detail and at least have a portfolio that showcases any automotive art.

...Optimization (ACO) algorithm that can read numbers in a matrix to calculate the shortest distance and its respective cost. Key Features: - The algorithm should respect origin and destination points, which will be indicated by specific row and column numbers. - Ideally, the code should be able to parse a .xlsx file format. Desired Skills: - Proficiency in Python programming language - Experience with optimization algorithms, particularly the Ant Colony Optimization algorithm. - Familiarity with .xlsx file parsing. I already have a basic code and can provide it to you as reference material; however, I need someone to improve and expand on this code to meet the requirements. It is essential for the proposed solution to use Python, as it's the language I'm most ...

I need an experienced PowerShell developer to create a script that logs me into , downloads today's menu, and displays it on a window. Requirements: - The script should log in to bosch.aramark.cz. - After log...should download today's menu. - The menu should be displayed in a window. - The menu display should be in the format: "Number of menu : Text of menu" with each number on a separate line and menu text following it. - The menu number should be displayed before the text. Ideal Skillset: - Proficient in PowerShell scripting. - Familiarity with web scraping is preferred. - Good understanding of GUI development. - Experience in parsing and displaying structured data is a plus. Please ensure the script is user-friendly and efficient. A clean, si...

...importing product data from XML sheets. The data needs to be imported into multiple Prestashop faced search feature tables. Key project details: - I need the product information to be imported - The data needs to be updated daily and in real-time - Multilingual support is not required, so a single language is sufficient Ideal Skills and Experience - Proficiency in working with XML data and importing it into systems - Expertise in Prestashop and its search feature tables - Experience with real-time data updates in web applications - Strong problem-solving skills and attention to detail Import data from xml sheets into multiple prestashop faced search feature table. Here's an outline of the tasks Script to Parse XML for Ni...

As a client with emphasis on quality, I need the support of an experienced Python programmer who can take charge of the frontend aspect of my web development project. At the core of this project are the following requirements: - Full proficiency in Python as the main programming language for the task - Demonstrated experience in frontend web development using Python - Familiarity with the best practices in Python programming - Capacity to effectively communicate, provide regular updates and accept feedback The missing response for the third question won't be an issue — I am more interested in a Python programmer who can bring their own unique ideas and solutions. You are encouraged to showcase your creative problem-solving skills. Apply if you have the necessa...

I'm looking for an experienced freelancer to create a Postman script that will automate the login process for without requiring any manual intervention. Here ... - You should be able to simulate entering the email and password, clicking the login button, and retrieving headers for subsequent actions on the front. - Upon successful login, the output data format should be in JSON. Ideal Skills and Experience: - Proficiency in working with Postman and creating scripts for automation. - Strong knowledge of HTTP methods. - Experience with handling and parsing JSON data. - Familiarity with cookies and headers in HTTP requests is a plus. Please note that the successful delivery of this project requires meticulous attention to detail and a solid understanding of web...

...LinkedIn connections parsing using a cookie file. The target is to uncover and analyze mutual connections between my personal friend's list and a CRM file. Important Aspects: - The script needs to efficiently extract the full profile details of LinkedIn connections, including their names, job titles, locations, and industries. The data about any mutual connections between my friends and my existing client database is distinctly relevant. - I also need the parser to generate records of connections between my LinkedIn friends and contacts in my CRM. - I would require the output to be well-organized and easy to navigate. It should be exportable and storable both as a CSV file and an Excel spreadsheet. Ideal Skills and Experience: - Proficiency in Python for web...

As a thriving startup, we are in need of a highly skilled Android Developer with proficiency in XML and Jetpack Compose to join our team. Primary Task: - Migrate a module written in XML to Jetpack compose : 4 screens + Business logic Skills and Experience needed: - Deep understanding and expertise in Android app development - Hands-on experience with XML Schemas; familiarity with XML Parsing and XML Web Services will be considered a plus - In-depth knowledge of Jetpack Compose, especially its UI toolkit Overall, we're seeking a developer who is deeply committed to enhancing the user experience through thoughtful and efficient app development. If you've mastered XML and Jetpack Compose and have a knack for Android development, this project is perfect for you....

I have a running Python file, who parse data from xml and insert it into sql server. Currently it isnt working. need an expert in python, who can fix it and upgrade few things as well.

...creating a customized web crawler for eBay and AliExpress. The primary function for this crawler will be to accept a list of keywords of any length and return specific data about those products. Here's what I need in detail: • Find top hot selling products at any given time • Crawl eBay and AliExpress for specific product data based on entered keywords. • The data retrieved should include product names, quantities sold and locations of sellers, images, • The crawler should be capable of providing this information for a variable timescale, ranging from 1 to 30 days in the past. • The results should be sortable. Php or python preferably The task would best suit a freelancer with previous experience de...

I'm in need of a custom Python parser using the pylatexenc library. It should mainly feature: - Special Feature Parsing: This parser must be able to parse through figures, tables, and equations specifically, while remaining in original LaTeX format. - Format Conversion: convert to simple text The ideal candidate for this project will have proven Python skills, familiarity with the pylatexenc library, and knowledge of LaTeX. They should also have experience with custom parser creation, and be familiar with converting LaTeX into other formats. Note: extensive testing on sample latex projects needs to be conducted to make sure its generalizability.

...video file and a JSON file (Google Vision API output) as input. Parse the JSON file to extract subtitle information and their corresponding timestamps. Use the subtitle timestamps to segment the video whenever the subtitles change. Save the segmented video clips with a naming convention: segment_[index]_[text].mp4, where [index] is a sequential number and [text] is the corresponding subtitle text. Ensure the script is well-documented, efficient, and handles potential errors gracefully. Provide clear instructions on how to run the script and any dependencies required. Requirements: Strong proficiency in Python programming. Experience with video processing libraries such as OpenCV or MoviePy. Familiarity with parsing JSON data. Knowledge of working with file I/O ope...

...WhatsApp whenever new data is entered into an AppSheet application connected to Google Sheets. Key Requirements: Integration between AppSheet and Google Sheets is already established. Develop a mechanism to trigger notifications in real-time whenever a new entry is made in the Google Sheet through AppSheet. Create customizable message templates to populate WhatsApp messages with data from the newly entered form. Ensure secure and reliable communication between AppSheet and WhatsApp Business API. Implement error handling mechanisms to address any potential issues during data transfer and messaging. Technical Approach: Utilize the WhatsApp Business API to establish a communication channel between AppSheet and WhatsApp. Implement webhooks in AppSheet to detect new...

...social, or financial well-being due to addiction to obscene content consumption. - Online Resource and Literature Review: Including an extensive literature review is optional, but would significantly enrich the project. A strong ability to parse and distill existing published studies is a welcome skill. - Analysis: I require the output to consist of a blend of both experimental data and theoretical analysis. This requires a candidate experienced in designing experiments as well as constructing meaningful theoretical discussion based on the collected data. - Further help with research publishing is very welcome The ideal candidate should have robust analytical skills and a genuine passion for scientific research. A demonstrable track record in academic research ...

Dear Client, I'm thrilled at the prospect of working with you to develop your Telegram bot. Based on the outlined features, I propose a comprehensive solution encompassing message parsing, database integration, payment handling, order processing, user balance management, notification delivery, and file management. With meticulous attention to detail and a commitment to excellence, I am confident in delivering a high-quality product that exceeds your expectations. Please find the proposed quote below: Total Project Cost:20 EUR Timeline: 04/18/2024 I'm eager to discuss this further and address any questions or concerns you may have. Thank you for considering my proposal, and I look forward to the opportunity to collaborate with you. Best regards, Meles Zawude

Zapier Email parser to read emails from a specific account. - Zap will read the email and parse its content. (complexity depends on the data) Zap Web hook - Calls the php file and sends parsed email content in the selected format (JSON) PHP Script to read the hook - Read the JSON and make the calculation. PHP Script to calculate and create report - Create a report – html format Zap email back report to the customer - Send email with the html report to the customer

I'm looking for a skilled python developer who can build a functional Telegram bot. This bot will include these features: - Message parsing and responses, enabling a fluid interaction with users. - Database integration, which is crucial for storing user data and other information. - Payment handling, to facilitate easy financial transactions. - A built-in order function, to streamline user orders. - The bot should also have the capacity to manage and present user balance systems. - Delivery of notifications to users is essential. - The bot should be able to send files as part of its interaction with users. If you're experienced in Telegram bot development and possess excellent Python programming skills, your expertise would be of great value to this project. Profici...

I'm looking for a skilled professional who can crop the complete content of a website and save it in a zip file to be deployed on a new server. The website is a small Wordpress with about 41 pages (as per sitemap). Content must not be saved as Wordpress, but static html to be deployed on another server. Key Requirements: - Crop all website content including subpages. - Save the cropped content in a compressed zip file. - The purpose of this cropping is to save the content for future use. - all files must be included, esprecially but not limited to images, js, css, ... - inner paths must be relative paths. If you're confident in your ability to deliver this and can ensure all the content is correctly saved, please bid accordingly. IMPORTANT READ THIS: Au...

I'm seeking an expert in artificial intelligence and ecommerce, specifically with experience in WooCommerce, to implement a visual search feature on my online home decor store. The AI should be able to efficiently parse through product images, significantly improving the user search experience. Key requirements include: - Proficiency in AI and machine learning technologies - Proven experience in implementing AI visual search - Familiarity with home decor elements can be beneficial Your goal is to enable my website to search through product images using advanced AI. I look forward to seeing how you can transform my site's user experience with this project.

I'm looking for a Python expert to develop a program that verifies if an idea or title has been mentioned on Google Search and YouTube. The program should: - Focus on both text and video data - Present results in a dashboard format The ideal candidate will have comprehensive knowledge of Python and be familiar with data parsing and web scraping for Google Search and YouTube. Understanding how to create user-friendly dashboards is also a key requirement. Can't wait to see your innovative solutions!

I'm in need of a proficient developer to create an MRZ Passport scanner using ASP.NET VB.NET. The software will be hosted on a local server for mobile access and use to scan regular passport...scanned passport information (Name, Nationality, Date of birth, Passport Issue Date, Expiry Date, and Date of birth) is accurately captured and saved in respective fields in a designated MySQL table The ideal candidate will have previous experience HR development using ASP.NET, VB.NET and a strong background in MySQL database manipulation and architecture. Familiarity with MRZ Passport scanning and parsing would be advantageous. This is a demo of a similar app: Only open source free SDKs to be used, like Tesseract or EmguCV or Open CV etc

I'm in need of a skilled developer who can assist me in parsing a CSV file with a primary focus on extracting date/time data. Key Project Requirements: - Experience with CSV file parsing - Proficient in data extraction, specifically date/time information - Ability to store and present extracted data in an Excel format This project will require a good understanding of handling CSV files and data extraction. Prior experience in similar projects would be a plus. Please provide relevant examples of similar work when bidding. Swift completion, attention to detail, and accuracy are critical for this task. Efficiency and cleanliness of your code are also very important.

I'm looking for an expert to design a web crawler to extract email addresses from specific company websites. The ideal candidate should be experienced both in web crawling and email data extraction. Key Tasks: - Crawl targeted company websites for email data extraction - Ensure the accuracy and integrity of all extracted emails Skills and Experience: - Experience with web crawling and data extraction technologies - Proven track record in email data extraction - Excellent analytical and problem-solving abilities - Familiarity with common web interrogatories for more efficient data capture is an asset - Strong attention to detail in order to capture complete and valid email addresses The successful candidate wil...

...efficient. Though it's not a tough job, it could be time-consuming due to the attention to detail required. Ideal Skills & Experience: - Expertise in Python programming - Experience with machine learning algorithms (preferably decision trees) - Strong attention to detail to create unique solutions - Good problem-solving skills to foresee potential issues and improvements The work may involve: - Parsing through my existing code, understanding functionality - Identifying areas for code uniqueness and efficiency - Implementing these changes without losing the actual functionality Please note that while additional features are appreciated, the primary goal is to refine and improve the existing code's uniqueness and efficiency. The successful applicant should have a...

I'm seeking assistance if manipulation of CT scan data on Varian/Dicom file. The realm of the manipulation involves tracking the dates when the images were taken. Having experience in healthcare, medical imaging, or data management would be beneficial. A strong understanding of data structures dictated by medical imaging devices and an ability to parse and manipulate this information is essential. - Task: Involves going through one image, extracting the date it was captured, and organizing all images accordingly. - Skills: Proficiency in CT scan image data interpretation, programming, and organization. Past experience in a similar task will be highly valued. - Outcomes: A properly dated and organized database of CT scan images.

I'm in need of software that can convert news articles and blog posts from Facebook into RSS feeds. The software should be able to automatically scan and convert new and updated posts into the feed. Skills and experience: - Proficient in RSS feed standards - Experience with Facebook's API - Can handle parsing and converting information from social media platforms. - Prior experience in software development with similar functionality would be a distinct advantage. The objective of this project is to seamlessly convert and deliver chosen Facebook content to my readers in a convenient format. Retroactive fetching would be a plus but is not mandatory. Making it as user-friendly and efficient as possible is the goal here.