In most cases it is. However it really depends on the website and, more importantly, on what you are going to use that data for.

For instance, extracting the whole database of apartments from zillow.com and making a similar website with their data is considered as unfair competition and it is illegal.However, extracting this same type of data for the purpose of deriving new data or performing a marketing study is typically fine.

Our legal adviser can advise you on your specific case. Please tell us what website you need to extract and what you intend to do with this data afterwards, and we shall analyze your specific case.


We need DB4ALL to periodically extract the data from a website. How will we get the extracted data?

There are several options:
  • We send you the data by email or ftp (XML, JSON, CVS...)
  • You pull the data in XML from our web server.
  • We push the data in XML to your web server.
  • We connect to your DBMS and update your database.
  • You connect to our DBMS and get our database.
  • We set up a master and slave servers.
  • Other solutions can also be provided.


Why not do the job yourself?

To reduce costs and increase productivity, as simple as that. Building your own data extractor is time consuming and expensive. Moreover, as websites change their layout, your ad-hoc solution may not work anymore and you need to spend more time updating and testing your code. As we are experts in this business, we can provide a better quality job, adapting quickly to website layout changes, at a lower cost.


Rather than providing a complete snapshot of the website's database each time, can DB4ALL send us the update (only the data that has changed)?

Sure. Some websites allow displaying only the changes since the previous visit, and some do not. When they do not, we need to crawl the entire website each time. However, once we have done so, we can send you only the updates.