Comments on: Import Wikipedia articles into SQL Server with SSIS

By: Dapinder

Dapinder — Thu, 18 Feb 2010 11:47:38 +0000

Hi,

Thanks for the article . This is informative. What I am looking for right now is an article which can help me to handle a xml schema using user defined data types (i.e a type defined using xs:simpletype) . SSIS does not picks up data defined using user defined type. I tried a lot and it seems everytime I miss something inthe implementation. Also it may be a case that SSIS does not support user defined types. can you help me in doing it ? Any suggestion would be of great help.

By: Benny

Benny — Tue, 29 Sep 2009 10:36:41 +0000

Thanks a lot for this tutorial. I’m even more curious to add some other advanced interconnectivity into the SQL server but don’t know how. For example, I’d like to have all the categories information of each article be preserved in my local database. Another point is that I’d hope to import two languages of wikipedia into the local database, and be able to have interconnection for the articles talking about the same thing(just like the column “languages” on the left side of an wikipedia article). Would you please give some advice on the two points? Thanks!!

By: Taylor Gerring

Taylor Gerring — Fri, 05 Jun 2009 13:08:45 +0000

@Balaji L

All links are working for me

By: Balaji L

Balaji L — Fri, 05 Jun 2009 09:17:48 +0000

Hi, Not able to download the xml file (enwiki-latest-pages-articles.xml.bz2). Seems to be URL is not working. can you pls post it again.

By: Sergio

Sergio — Mon, 18 May 2009 17:33:29 +0000

Yes, I tried and it worked like a charm. I even recreated the whole Wikipedia example from scratch to see if I was missing something, but it also worked.

I’ve read in a few forums the problem might be in the XSD file, but I still haven’t found the culprit. I also tried letting SSIS generate an XSD from (a small sample) of my XML file, but that didn’t work either. I’ll play around with the XSD a bit more to see if I can make it work.

By: Taylor Gerring

Taylor Gerring — Mon, 18 May 2009 15:53:22 +0000

@Sergio

Did you ever try the Wikipedia XML file itself? I’m curious if you still get the OutOfMemory exception.

By: Sergio

Sergio — Sat, 16 May 2009 01:54:54 +0000

Hi,

While I download the 4.x GB wikipedia file, I’m trying to reproduce this simple extract and load scenario with one of my own files (approx. 450 MB). However, I’m not getting the “streamlined” behavior from your image (all yellow blocks). SSIS starts by only processing the XML Source and after a while it crashes with an OutOfMemory exception, it never starts processing the destination.

I can’t seem to find any options for this in the XML source properties or editors. I’m not doing any transformations.

Any particular options I should look for?

Thanks in advance