Package org.apache.pinot.common.utils.fetcher

Interface SegmentFetcher

All Known Implementing Classes:

BaseSegmentFetcher, HttpSegmentFetcher, HttpsSegmentFetcher, PinotFSSegmentFetcher

public interface SegmentFetcher

Method Summary

Modifier and Type	Method	Description
void	fetchSegmentToLocal(URI uri, File dest)	Fetches a segment from URI location to local.
void	fetchSegmentToLocal(List<URI> uri, File dest)	Fetches a segment to local from any uri in the given list.
File	fetchUntarSegmentToLocalStreamed(URI uri, File dest, long rateLimit)	Fetches a segment from URI location and untar to local in a streamed manner
void	init(PinotConfiguration config)	Initializes the segment fetcher.

Method Detail

init

void init(PinotConfiguration config)

Initializes the segment fetcher.

fetchSegmentToLocal

void fetchSegmentToLocal(URI uri,
                         File dest)
                  throws Exception

Fetches a segment from URI location to local.

Throws:

Exception

fetchUntarSegmentToLocalStreamed

File fetchUntarSegmentToLocalStreamed(URI uri,
                                      File dest,
                                      long rateLimit)
                               throws Exception

Fetches a segment from URI location and untar to local in a streamed manner

Throws:

Exception

fetchSegmentToLocal

void fetchSegmentToLocal(List<URI> uri,
                         File dest)
                  throws Exception

Fetches a segment to local from any uri in the given list.

Throws:

Exception