login about faq

I have written a spider using CkSpider. This is my code.

include<ckspider.h>

include<ckstringarray.h>

include<ckstring.h>

include <stdio.h>

void main(void) {

CkSpider spider;
CkStringArray seenDomains;
CkStringArray seedUrls;
const char * baseUrl = "http://www.xyz.com/mobile.aspx?article=yes&pageid=1&sectid=edid=&edlabel=TOIPU&mydateHid=09-05-2014&pubname=Times+of+India+-+Pune&edname=&articleid=Ar00102&publabel=TOI";
const char * domain;
spider.Initialize(baseUrl);

if(spider.CrawlNext())
{
    printf("\n %s", spider.domain());
    printf("\n %s", spider.lastHtml());
}
else
{
    printf("\n not crawled.");
}

}

I need to scrape data from a website & also convert it in XML form any suggestions ?

asked May 09 '14 at 07:12

jo_himan's gravatar image

jo_himan
1144

Be the first one to answer this question!
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or __italic__
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×59
×3

Asked: May 09 '14 at 07:12

Seen: 993 times

Last updated: May 09 '14 at 07:12

powered by OSQA