Showing posts with label Sesame. Show all posts
Showing posts with label Sesame. Show all posts

Play with sesame native store for large triples

The Sesame Native Store is reported to scale up to about 100-150 million triples (depending on hardware and data-set characteristics). And Rivuli also mentioned in his blogpost that it is becomeing slow while the data set normally over 600,0000 triples 500MB for inserting files to Native Store of sesame.

Tested for chunk commit in sesame API, see example here, that is, stop auto commit and commit in every chunk size you set.

  • Test: commit every 5 triples, how many will be committed if there's exception in 14th triple(statement)?
    • A: 10
    • B: 13
    • Answer: 13 ( It will be committed before the exception point)


Sesame 2 install

Requirement :

   - Java 1.7
   - Tomcat 8

Install Sesame2 :

1. Download sesame 

2. Put two war files within war folder to webapps folder in Tomcat

3. You could visit http://localhost:8080/openrdf-workbench to check it is working or not.

4. New repository with Native Java Store (which is store in drive)


5. Add data files with your format to repository and you could use SPARQL to query big triple data as well.


Try to load .nq file with over 1GB and not working well using web interface and use the API (sesame as library), then, it again have problem with .nq file!!!




----------------

View local store from web interface: