Request for Wikipedia API Format. - Mediawiki-api

Nicolas Vervelle

26 Apr 26 Apr

5:23 a.m.

Hi, To have examples of responses from API, you just have to look at the documentation and for each command you have URL examples that show you the answer if you click on it. The response is then displayed directly in your browser. Nico On Thu, Apr 26, 2012 at 2:18 PM, Krishna Kranth <krishnakranth.m(a)gmail.com>wrote;wrote:

...

Dear Team, I am planning to start a new website containing celebrities from different areas like in sports, movies and politics. For this I am planning to exract data from Wikipedia using API in XML or JSON format. Can someone send me Wikipedia API and the format of response I get? I am pretty much new to this type of technical stuff. I tried going through the document but could not understand much in detail. An example format will be of great use. Thanks in advance. Regards M.Krishna Kranth Team works means more We less Me. _______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

Reply

Timothy Helck

5:43 a.m.

Krishna, Try this page: http://en.wikipedia.org/w/api.php I find some of the other documentation a bit confusing. The above link seems to have everything in one place. It takes a while to go through it. Once you gain some familiarity with the API you will be able to formulate more specific questions, then you will find the people on this mailing list to be very helpful. Good luck! Tim Helck On Thu, Apr 26, 2012 at 8:18 AM, Krishna Kranth <krishnakranth.m(a)gmail.com>wrote;wrote:

...

Dear Team, I am planning to start a new website containing celebrities from different areas like in sports, movies and politics. For this I am planning to exract data from Wikipedia using API in XML or JSON format. Can someone send me Wikipedia API and the format of response I get? I am pretty much new to this type of technical stuff. I tried going through the document but could not understand much in detail. An example format will be of great use. Thanks in advance. Regards M.Krishna Kranth Team works means more We less Me. _______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

Reply

Hasan Dalip

3:59 a.m.

Krishna, You can use this too: http://en.wikipedia.org/wiki/Special:Export to export many pages in the XML format by simply inserting the names of the pages (or inserting a category name, for example a category that lists the celebrities). With this, you can export 1000 pages per time. Or you can go to the http://en.wikipedia.org/wiki/Wikipedia:Database_download to get the entire wikipedia XML. Then you can filter whenever you want :-). []s On Fri, Apr 27, 2012 at 7:38 AM, Krishna Kranth <krishnakranth.m(a)gmail.com>wrote;wrote:

...

Thanks for the link provided. I tried my best to understand how to extract data from Wikipedia using APIs. But I failed miserably. Please can someone help me out to give me a simpler link or example showing the data from Wikipedia. Something like this : http://api.rottentomatoes.com/api/public/v1.0/movies.json?apikey=e8qkmhd7s4… Click on the above link and check how simpler it is to get data from Rotten Tomatoes. Is there any link in that way? Thanks in advance. Regards M.Krishna Kranth Team works means more We less Me. On Thu, Apr 26, 2012 at 6:13 PM, Timothy Helck <timothy.helck(a)gmail.com>wrote;wrote:

Krishna, Try this page: http://en.wikipedia.org/w/api.php I find some of the other documentation a bit confusing. The above link seems to have everything in one place. It takes a while to go through it. Once you gain some familiarity with the API you will be able to formulate more specific questions, then you will find the people on this mailing list to be very helpful. Good luck! Tim Helck On Thu, Apr 26, 2012 at 8:18 AM, Krishna Kranth < krishnakranth.m(a)gmail.com> wrote:

Dear Team, I am planning to start a new website containing celebrities from different areas like in sports, movies and politics. For this I am planning to exract data from Wikipedia using API in XML or JSON format. Can someone send me Wikipedia API and the format of response I get? I am pretty much new to this type of technical stuff. I tried going through the document but could not understand much in detail. An example format will be of great use. Thanks in advance. Regards M.Krishna Kranth Team works means more We less Me. _______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

-- Daniel Hasan Dalip

Reply

Tom Hutchison

6:15 a.m.

http://en.wikipedia.org/w/api.php?format=xml&action=query&titles=Th… <http://en.wikipedia.org/w/api.php?format=xml&action=query&titles=The_Social_Network&prop=revisions&rvprop=content> or in json http://en.wikipedia.org/w/api.php?format=json&action=query&titles=T… <http://en.wikipedia.org/w/api.php?format=json&action=query&titles=The_Social_Network&prop=revisions&rvprop=content> or you can request multiple pages Just save and open in notepad to see the content format in json. Definitely play with the API Sandbox, http://en.wikipedia.org/wiki/Special:ApiSandbox You can also request more than one page at time. http://en.wikipedia.org/w/api.php?action=query&format=xml&prop=revi… <http://en.wikipedia.org/w/api.php?action=query&format=xml&prop=revisions&rvprop=content&titles=The_Social_Network%7CTitanic_%281997_film%29> what the API will generate /w/api.php?action=query&prop=revisions&format=xml&rvprop=content&titles=The_Social_Network%7CTitanic_(1997_film) <http://en.wikipedia.org/w/api.php?action=query&prop=revisions&format=xml&rvprop=content&titles=The_Social_Network%7CTitanic_%281997_film%29> You just need to add in the http://en.wikipedia.org or whatever language sub domain you need like: http://de.wikipedia.org/w/api.php?action=query&prop=revisions&forma… <http://de.wikipedia.org/w/api.php?action=query&prop=revisions&format=xml&rvprop=content&rvlimit=5&titles=The_Social_Network> gives you the German translation. Tips on the API Sandbox is: 1. Format=choose it (format=xml) 2. Action - Set to Query (action=query) 3. Action - Right below, use drop down to choose prop value (prop=revisions). 4. Choose what you want, content (rvprop=content) 5. Loose the revisions to return (rvlimit), clear the input box. I don't know why they set that 10 automatically, let the user decide or else you'll get a snapshot of the last 10 versions of the page. 6. Pick the title, you can get multiple titles by separating them with the pipe | character. The problem you will have to address is parsing out the wiki markup if you just want pure text content. You'll have to find a sanitizer to strip out all the wiki markup. Tom ------------------------------------------------------------------------ On 4/27/2012 6:38 AM, Krishna Kranth wrote:

...

Thanks for the link provided. I tried my best to understand how to extract data from Wikipedia using APIs. But I failed miserably. Please can someone help me out to give me a simpler link or example showing the data from Wikipedia. Something like this : http://api.rottentomatoes.com/api/public/v1.0/movies.json?apikey=e8qkmhd7s4… <http://api.rottentomatoes.com/api/public/v1.0/movies.json?apikey=e8qkmhd7s4hambanqsbwy9ua&q=The+Social+Network> Click on the above link and check how simpler it is to get data from Rotten Tomatoes. Is there any link in that way? Thanks in advance. Regards M.Krishna Kranth Team works means more We less Me. On Thu, Apr 26, 2012 at 6:13 PM, Timothy Helck <timothy.helck(a)gmail.com <mailto:timothy.helck@gmail.com>> wrote: Krishna, Try this page: http://en.wikipedia.org/w/api.php I find some of the other documentation a bit confusing. The above link seems to have everything in one place. It takes a while to go through it. Once you gain some familiarity with the API you will be able to formulate more specific questions, then you will find the people on this mailing list to be very helpful. Good luck! Tim Helck On Thu, Apr 26, 2012 at 8:18 AM, Krishna Kranth <krishnakranth.m(a)gmail.com <mailto:krishnakranth.m@gmail.com>> wrote: Dear Team, I am planning to start a new website containing celebrities from different areas like in sports, movies and politics. For this I am planning to exract data from Wikipedia using API in XML or JSON format. Can someone send me Wikipedia API and the format of response I get? I am pretty much new to this type of technical stuff. I tried going through the document but could not understand much in detail. An example format will be of great use. Thanks in advance. Regards M.Krishna Kranth Team works means more We less Me. _______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org <mailto:Mediawiki-api@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/mediawiki-api _______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org <mailto:Mediawiki-api@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/mediawiki-api _______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

Reply

Max Semenik

4:18 a.m.

On 09.05.2012, 14:38 Krishna wrote:

...

Dear Team,

...

How can I get the image of a personality which is shown in info box in wikipedia pages. Please provide me with the query link.

action=opensearch&format=xml gives you thumbnails associated with pages, however the algorithm is extremely poor and you will not get images from infoboxes at all. I hope we'll be able to deploy the PageImages extension within a month which should resolve this problem. -- Best regards, Max Semenik ([[User:MaxSem]])

Reply

Nicolas Vervelle

4:35 a.m.

Hi, You will probably have to code a few things to get that information. I would suggest : - Use the API to retrieve the content of section 0 of the page (all the wikitext before the first title) - Develop some code to parse this wikitext : retrieve the value of one parameter (example "image) of one template (example "Infobox politician") - Use the API to retrieve the image The API has no know knowledge on how each project has decided to organize pages (which infobox, ...), so I think you have to do the analysis of the page text to retrieve information you want. Nico On Wed, May 9, 2012 at 12:38 PM, Krishna Kranth <krishnakranth.m(a)gmail.com>wrote;wrote:

...

Dear Team, How can I get the image of a personality which is shown in info box in wikipedia pages. Please provide me with the query link. On Fri, Apr 27, 2012 at 6:45 PM, Tom Hutchison <tom(a)hutch4.us> wrote:

http://en.wikipedia.org/w/api.**php?format=xml&action=query&** titles=The_Social_Network&**prop=revisions&rvprop=content<http:/… http://en.wikipedia.org/w/**api.php?format=xml&action=** query&titles=The_Social_**Network&prop=revisions&rvprop=**conte…

or in json http://en.wikipedia.org/w/api.**php?format=json&action=query&** titles=The_Social_Network&**prop=revisions&rvprop=content<http:/… http://en.wikipedia.org/w/**api.php?format=json&action=** query&titles=The_Social_**Network&prop=revisions&rvprop=**conte…

or you can request multiple pages Just save and open in notepad to see the content format in json. Definitely play with the API Sandbox, http://en.wikipedia.org/wiki/** Special:ApiSandbox <http://en.wikipedia.org/wiki/Special:ApiSandbox> You can also request more than one page at time. http://en.wikipedia.org/w/api.**php?action=query&format=xml&** prop=revisions&rvprop=content&**titles=The_Social_Network|** Titanic_(1997_film)<http://en.wikipedia.org/w/api.php?action=query&f… http://en.wikipedia.org/w/**api.php?action=query&format=** xml&prop=revisions&rvprop=**content&titles=The_Social_** Network%7CTitanic_%281997_**film%29<http://en.wikipedia.org/w/api.php?ac…

what the API will generate /w/api.php?action=query&prop=**revisions&format=xml&rvprop=** content&titles=The_Social_**Network%7CTitanic_(1997_film) < http://en.wikipedia.org/w/**api.php?action=query&prop=** revisions&format=xml&rvprop=**content&titles=The_Social_** Network%7CTitanic_%281997_**film%29<http://en.wikipedia.org/w/api.php?ac…

You just need to add in the http://en.wikipedia.org or whatever language sub domain you need like: http://de.wikipedia.org/w/api.**php?action=query&prop=** revisions&format=xml&rvprop=**content&rvlimit=5&titles=The_** Social_Network<http://de.wikipedia.org/w/api.php?action=query&prop=r… http://de.wikipedia.org/w/**api.php?action=query&prop=** revisions&format=xml&rvprop=**content&rvlimit=5&titles=The_** Social_Network<http://de.wikipedia.org/w/api.php?action=query&prop=r…

gives you the German translation. Tips on the API Sandbox is: 1. Format=choose it (format=xml) 2. Action - Set to Query (action=query) 3. Action - Right below, use drop down to choose prop value (prop=revisions). 4. Choose what you want, content (rvprop=content) 5. Loose the revisions to return (rvlimit), clear the input box. I don't know why they set that 10 automatically, let the user decide or else you'll get a snapshot of the last 10 versions of the page. 6. Pick the title, you can get multiple titles by separating them with the pipe | character. The problem you will have to address is parsing out the wiki markup if you just want pure text content. You'll have to find a sanitizer to strip out all the wiki markup. Tom ------------------------------**------------------------------** ------------ On 4/27/2012 6:38 AM, Krishna Kranth wrote: > Thanks for the link provided. I tried my best to understand how to > extract data from Wikipedia using APIs. But I failed miserably. Please can > someone help me out to give me a simpler link or example showing the data > from Wikipedia. > > Something like this : http://api.rottentomatoes.com/** > api/public/v1.0/movies.json?**apikey=**e8qkmhd7s4hambanqsbwy9ua&q=** > The+Social+Network<http://api.rottentomatoes.com/api/public/v1.0/movies.… > http://api.rottentomatoes.**com/api/public/v1.0/movies.**json?apikey=** > e8qkmhd7s4hambanqsbwy9ua&q=**The+Social+Network<http://api.rottentom… >

> > > Click on the above link and check how simpler it is to get data from > Rotten Tomatoes. Is there any link in that way? > > Thanks in advance. > > Regards > M.Krishna Kranth > Team works means more We less Me. > > > On Thu, Apr 26, 2012 at 6:13 PM, Timothy Helck <timothy.helck(a)gmail.com<mailtomailto: > timothy.helck(a)gmail.**com <timothy.helck(a)gmail.com>>> wrote: > > Krishna, > > Try this page: http://en.wikipedia.org/w/api.**php<http://en.wikipedia.org/w/api.php> > > I find some of the other documentation a bit confusing. The above > link seems to have everything in one place. It takes a while to go > through it. Once you gain some familiarity with the API you will > be able to formulate more specific questions, then you will find > the people on this mailing list to be very helpful. > > Good luck! > > Tim Helck > > > > > On Thu, Apr 26, 2012 at 8:18 AM, Krishna Kranth > <krishnakranth.m(a)gmail.com <mailto:krishnakranth.m@gmail.**com<krishnakranth.m@gmail.com>>> > wrote: > > Dear Team, > > I am planning to start a new website containing celebrities > from different areas like in sports, movies and politics. For > this I am planning to exract data from Wikipedia using API in > XML or JSON format. Can someone send me Wikipedia API and the > format of response I get? I am pretty much new to this type of > technical stuff. I tried going through the document but could > not understand much in detail. An example format will be of > great use. > > Thanks in advance. > > Regards > M.Krishna Kranth > Team works means more We less Me. > > ______________________________**_________________ > Mediawiki-api mailing list > Mediawiki-api@lists.wikimedia.**org<Mediawiki-api@lists.wikimedia.org> > <mailto:Mediawiki-api@lists.**wikimedia.org<Mediawiki-api@lists.wikimedia.org> >

> > https://lists.wikimedia.org/**mailman/listinfo/mediawiki-api<https://lis… > > > > ______________________________**_________________ > Mediawiki-api mailing list > Mediawiki-api@lists.wikimedia.**org<Mediawiki-api@lists.wikimedia.org> > <mailto:Mediawiki-api@lists.**wikimedia.org<Mediawiki-api@lists.wikimedia.org> >

> > https://lists.wikimedia.org/**mailman/listinfo/mediawiki-api<https://lis… > > > > > ______________________________**_________________ > Mediawiki-api mailing list > Mediawiki-api(a)lists.wikimedia.**org <Mediawiki-api(a)lists.wikimedia.org> > https://lists.wikimedia.org/**mailman/listinfo/mediawiki-api<https://lis… > ______________________________**_________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.**org <Mediawiki-api(a)lists.wikimedia.org> https://lists.wikimedia.org/**mailman/listinfo/mediawiki-api<https://lis…

_______________________________________________ Mediawiki-api mailing list Mediawiki-api(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

Reply

Krinkle

8:34 a.m.

On May 9, 2012, at 2:46 PM, Krishna Kranth wrote:

...

Dear Team, Is there any commercial restriction on using Wiki information. Is it free to use the information? Any restriction on number of requests that can be sent? Regards M.Krishna Kranth

See [1] for API Etiquette. As for restriction on usage, that depends on which wiki you get the information from. Every MediaWiki install has a footer. If the MediaWiki install is publicly licensed it will contain a copyright/license note. Wikipedia, for example, says: "Text is available under the Creative Commons Attribution-ShareAlike[2] License." -- Krinkle [1] https://www.mediawiki.org/wiki/API:Etiquette#Request_limit [2] https://en.wikipedia.org/wiki/Wikipedia:Text_of_Creative_Commons_Attributio…

Reply