Home

Introduction

The Supplejack Harvester Core gem provides the Parser DSL that is used in the Supplejack Manager and Supplejack Worker

The purpose of the gem is to abstract all the DSL specific code for the manager and the worker.

Architecture

It follows a very simple architecture where you have adapters or strategies for different types of harvests that abstract most of the complexity and let the harvest operator use a common language for defining how to extract the important data from every source.

Adapters

The following adapters have been implemented:

• Open Archives Initiative
• Really Simple Syndication
• XML
• JSON

Parser DSL

This gem provides the Parser DSL functionality.

Testing

Since each adapater and each parser file are just ruby classes with very little dependencies it is very easy to test them with a predefined set of data.