Difference between revisions of "Zimit"

From openZIM
Jump to navigation Jump to search
(New "Context" section)
Line 9: Line 9:
== Principle ==
== Principle ==


 
the principles of Zimit are:
* Crawl the remote WebSite to retrieve all the necessary content
* Save all the retrieved content in WARC file
* Convert WARC file to ZIM file (this implied embedding a reader in the WARC file, so this is a kind of offline Web App)
* Read the ZIM file any Kiwix reader


== URL rewriting ==
== URL rewriting ==

Revision as of 08:18, 22 May 2023

Zimit is a tool allowing to create a ZIM file of "any" Web site.

Context

openZIM provides many scrapers software solutions for dedicated source of content like: TED, Wikipedia (Mediawiki, Project Gutenberg, ...). This is a great solution to provide quality ZIM files, but developing and maintaining each of them is costly.

Zimit is our approach to allow to scrape "random" Web site and get an acceptable snapshot to be used offline.

Principle

the principles of Zimit are:

  • Crawl the remote WebSite to retrieve all the necessary content
  • Save all the retrieved content in WARC file
  • Convert WARC file to ZIM file (this implied embedding a reader in the WARC file, so this is a kind of offline Web App)
  • Read the ZIM file any Kiwix reader

URL rewriting

Source code