|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectuk.ac.starlink.ttools.cone.BlockUploader
public class BlockUploader
Works with an UploadMatcher dividing the input table into chunks and uploading them separately to produce an arbitrarily large result while each upload/match operation is of a limited size.
Constructor Summary | |
---|---|
BlockUploader(UploadMatcher umatcher,
int blocksize,
long maxrec,
String outName,
JoinFixAction uploadFixAct,
JoinFixAction remoteFixAct,
ServiceFindMode serviceMode,
boolean oneToOne,
boolean uploadEmpty)
Constructor. |
Method Summary | |
---|---|
StarTable |
runMatch(StarTable inTable,
QuerySequenceFactory qsFact,
StoragePolicy storage)
Performs an upload join in blocks. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public BlockUploader(UploadMatcher umatcher, int blocksize, long maxrec, String outName, JoinFixAction uploadFixAct, JoinFixAction remoteFixAct, ServiceFindMode serviceMode, boolean oneToOne, boolean uploadEmpty)
umatcher
- upload matcherblocksize
- maximum number of rows per uploaded blockmaxrec
- maximum number of output rows accepted in totaloutName
- name of output tableuploadFixAct
- name deduplication policy for upload tableremoteFixAct
- name deduplication policy for remote tableserviceMode
- upload match modeoneToOne
- true iff output rows match 1:1 with input rowsuploadEmpty
- determines behaviour if there are no input rows:
true means attempt the match anyway,
false means throw an IOExceptionMethod Detail |
---|
public StarTable runMatch(StarTable inTable, QuerySequenceFactory qsFact, StoragePolicy storage) throws IOException
As currently implemented, the input table needs to have random access, and the output table has random access. It would be possible to stream on input and output to some extent, though each input chunk will still have to be random access.
The row indices given by ConeQueryRowSequence.getIndex
calls associated with the supplied qsFact
object
must correspond to the row indices in the supplied inTable
.
inTable
- input table, must have random accessqsFact
- object to generate positional queries when applied
to a tablestorage
- storage policy for storing raw result table
IOException
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |