3 {{ upvoteCount | shortNum }}
3 {{ upvoteCount | shortNum }}

Scraping and then Linking Data.. Some questions please..

by stephendnz
2 replies
Hi. I wonder if someone could set me on the right track about scraping vs crawling and how to 'link' infor from one website to another.. I am not sure what software I should be looking for to achieve the result I want.

So here is a brief on what i am trying to achieve.. I want to first scrape data from certain sites that I have already identified.. and place that information on my site.. but then I want to link that information so that if that information changes on the original site, then by default the copy of that info on my site would be updated as well.. or if that ad/info is deleted from the original site then it would be withdrawn from mine too..

I know that this can be done with API's from certain sites.. but do I need to do it that way.. or are there other ways..

Thanks in advance for any help you are able to offer..
#data #linking #questions #scraping
  • Profile picture of the author transcriptionservices
    Hi stephendnz,

    I would like to share my opinion with respect to legality;


    1) It is against the law; you cannot copy data from any site without the permission of the site owner
    2) Consequences can imagine, if it was violating the TOS, is ip blocking, account banning, civil suit, etc.


    As you told that if they update, it will reflect on your website, for that you can do one thing that takes RSS code of that particular site and place it on your website
    Signature

    Hi-Tech Transcription Services

    {{ DiscussionBoard.errors[9602655].message }}
  • Profile picture of the author Frank Donovan
    Originally Posted by stephendnz View Post

    So here is a brief on what i am trying to achieve.. I want to first scrape data from certain sites that I have already identified.. and place that information on my site...
    Sure, but first let me have your bank details so that I can scrape the funds from your account and place them in mine.
    Signature

    {{ DiscussionBoard.errors[9602712].message }}

Trending Topics