The full GoldenGATE workflow was demonstrated and reviewed several times during the three days of workshops. This was a useful exercise for it confirmed that all GoldenGATE components were working as web services. As noted in [M716report M7.16] this is a monolithic workflow. The slow process of working through the full GoldenGATE workflow confirmed the correctness of the decision to extract components from GoldenGATE for individual use in M716. During the workshops we were able to explore the use of these components as individual web services and were able to confirm that:
Owing to the amount of processing time a GoldenGATE web service may require (this is a result of the nature of the metadata extraction task, not a problem with the tool itself) the web srevices are not called directly from within Scratchpads. Instead, the services are enabled through the Oxford Batch Operation Engine OBOE in conjunction with Work Package 5.
Full integration will be achieved through OBOE's links to Scratchpads. The details of this work was discussed and agreed at the first of the workshops (see http://vbrant.eu/content/notes-oxford-workshop-21-november-2012).
For the purposes of the pilot review, we used GoldenGATE web services directly (as in M716) as well as through OBOE, to confirm both workflows. To use OBOE, the preferred long-term solution for integration into the Scratchpads infrastructure, in our pilot review, we navigated first to the OBOE home page and selected GoldenGATE services as shown below.
Screenshot showing OBOE's front page with GoldenGATE highlighted
After signing in to the system, the various GoldenGATE web services are available to the user. A dynamic web form, the fields can vary depending on the job requested, is displayed allowing the user to upload a file for processing and set any optional parameters. Then the job is submitted and the user can track its progress as shown below.
Screenshot showing the interim status report from OBOE while a GoldenGATE job is running
In this example the GoldenGATE web service to identify date information within a text is being run. On completion the results are presented to the user as shown below.
Screenshot showing the results from OBOE having run a GoldenGATE job
The results are returned as inline XML mark up.
This marked up file is available for the users immediate use and for further automation mobilising the data content through whatever tools the user already has or could have developed that exploit this metadata now it can be extracted.