Search is part of the fundamental infrastructure of the Internet. And, it is currently broken.

Why is it broken? It is broken for the same reason that proprietary software is always broken: lack of freedom, lack of community, lack of accountability, lack of transparency. Here, we will start to change all that.

Grub started back in 2000 with a simple concept of distributing part of the search process pipeline: crawling. In a way, we were a bit ahead of our time, but our intention then was what it is now. We want to help fix search.

Now, with the help of community members and Open Source developers our time has come again. Come be part of something greater. Come help us change the World.

Grub C# client 0.8.5 released

Submitted by thindil on Fri, 02/20/2009 - 09:58.

New version of Grub Next Generation C# client is available. Changes since last release (0.8.4):

- added Galician translation (author: Victor) #298: Translations into Spanish and Galician
- update German translation (author: HennR) #308: Translate the missing parts of the client to German
- fixed bug #305: Randomly crashed when clicked on the details window.
- fixed bug with crash client on invalid workunit file
- stop updating configuration file by auto-updater
- added ability to change amount of working crawlers during crawling
- some code optimization

Grub NG Python client 0.4 released

Submitted by Sealabs on Tue, 02/17/2009 - 12:18.

The fourth release of the Grub NG Python client is here!

This release features:

  • Support for the new workunits format, featuring more HTTP headers per request.
  • Added Uploading thread. Now all ARC uploads are executed by a single thread, to prevent server hammering. Features like upload bandwidth limit will be added in the future.
  • ...full changelog

Direct download

happy crawling :)

Grub Next Generation upload server 0.4 released

Submitted by thindil on Thu, 02/12/2009 - 09:22.

Fourth (and probably last) alpha of Grub Next Generation C# upload server is available. Changes since last release (0.3):

- added option to update database
- added option to run server in debug mode
- added option to autoclean temporary directory
- fixed and extended server API
- fixed bug with crash server on send incomplete .arc file
- fixed bug with crash server if few clients send this same .arc file simultaneously
- stop creating unnecessary .idx files
- rewrite sending .arc files to Hadoop

Grub C# client 0.8.4 released

Submitted by thindil on Wed, 02/04/2009 - 09:46.

New version of Grub Next Generation C# client is available. Changes since last release (0.8.3):

- rewrite processing workunits (for adding to crawlers more HTTP headers)
- small changes in communication between GUI and crawlers
- fixed bug with not stopping crawling on lost net connection
- fixed bug with creating sitemaps
- fixed bug with show disk usage by crawler during creating sitemaps
- small changes in GUI (Windows version)
- update Mono library to version 2.2 (Windows version)

Grub Next Generation upload server 0.3 released

Submitted by thindil on Fri, 01/30/2009 - 11:45.

Third alpha of Grub Next Generation C# upload server is available. Changes since last release (0.2):

- code optimization
- added auto-uploading .arc files to database
- added auto-checking for free space on disk
- simplify server start/stop/restart

You can download source code and zip compressed server from project page. At this moment, this is our main upload server, so if you want upload .arc files on it, you don't need to change dispatch server anymore.

« first‹ previous…2345678910next ›last »
Syndicate content