So, today we will look at data scraping from Amazon.com. It’s the largest online store in the world at the moment. Here you can find almost any goods – from clothing to sophisticated technical equipment. Amazon offers its suppliers direct delivery of goods to the customer. They also provide a continuous flow of customers to […]
Legality of use of data extractors
When using automatic data extractors, you should understand the aspects of the legality of their use. In fact, given the copyright issues of texts, descriptions, images, programs and other data on web pages, you may not always be able to use an automatic data extractor. First of all, it is necessary to inform that we […]
Why only x64 assembly
Keep in mind that the Data Excavator is a native indexing server and consumes a certain amount of resources, sometimes quite significant for the standard computer configuration. That’s why we don’t offer our clients to build x86 – in almost all cases the program’s work will exceed the memory limits for x86-processes and the program […]
Loading goods from suppliers websites
Working in the e-commerce segment, any seller sooner or later faces the need to collect data from the sites of various suppliers or marketplaces. Many suppliers do not provide data in a structured form, and offer to take it from a certain site or portal. Many suppliers are placed on marketplaces, and offer to use […]
Competitors prices monitoring
Working in the e-commerce segment, we often face the problem of monitoring the prices of competing projects. In today’s economy, we often cannot afford to go with the flow, as the digital era requires an immediate response to the changes around us. Even small price differences of 1-5% are important to many customers today. Without […]
What is data scraping?
Data mining, or as it is called, data extraction, is the process of extracting data from some website and exporting this data in some structured format. When we talk about the structured form, we mean a conditional “table” of data, or a library of the type “Key – value”. For various reasons, at some point […]
How to specify .CSS-selectors
When you start extracting data from some website, first of all you need to specify a list of .css or x-path selectors. In this case, we will talk about .css-selectors and their definitions. A CSS selector is a sequence of CSS rules that allow you to identify some html element or set of html elements […]