Skip navigation links
A B C D E F G H I J K L M N O P Q R S T U V W 

A

addBefore(DownstreamColumnData) - Method in class bdglue2.meta.transaction.DownstreamOperation
Add before image data pertaining to a column to this operation.
addColumn(DownstreamColumnMetaData) - Method in class bdglue2.meta.schema.DownstreamTableMetaData
Add a column to the table's meta data.
addColumn(DownstreamColumnData) - Method in class bdglue2.meta.transaction.DownstreamOperation
Add information pertaining to a column to this operation.
addTable(String, DownstreamTableMetaData) - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
Add this table to the list of tables we are managing, or replace it if the table is already present in the list.
asBigDecimal() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Use this for mapping "packed decimal" types.
asBoolean(String, String) - Method in class bdglue2.common.PropertyManagement
Return the requested property as a boolean value, setting a default value if it hasn't been initialized.
asBoolean() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Return the data from the String representation of the data encoded as a boolean value.
asByteBuffer() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Get the binary value that was given to the constructor and return it as an instance of ByteBuffer.
asBytes() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Get the binary value that was given to the constructor and return it as a byte array.
asDouble() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Return the value from the String representation of the field parsed as a double.
asFloat() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Return the value from the String representaion of the field parsed as a float.
asInt(String, String) - Method in class bdglue2.common.PropertyManagement
Return the requested property as an integer, setting a default value if it hasn't been initialized.
asInteger() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Return the value from the String representation of the field parsed as an integer.
asLong() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Return the value from the String representation of the field parsed as a long.
asString() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Get the string representation of this column as a String.
ASYNC_HBASE_BATCHSIZE - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
The batchsize for writing records to HBase.
ASYNC_HBASE_TIMEOUT - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
Timeout value after which asynchronous calls that have not returned are declared unsuccessful.
AsyncHbaseHelper - Class in bdglue2.publisher.asynchbase
A helper class that contains common funtionality that is leveraged both by the direct apply functionality in AsyncHbasePublisher and by the Flume BDGlueAsyncHbaseSink.
AsyncHbaseHelper() - Constructor for class bdglue2.publisher.asynchbase.AsyncHbaseHelper
 
AsyncHbasePublisher - Class in bdglue2.publisher.asynchbase
Publish data to HBase using the Async HBase API.
AsyncHbasePublisher() - Constructor for class bdglue2.publisher.asynchbase.AsyncHbasePublisher
 
AsyncHbasePublisherPropertyValues - Class in bdglue2.publisher.asynchbase
This class contains configuration constants used by the Big Data Glue Async Hbase Publisher, including property names and where appropriate the default values to use in the event that a property is not defined.
AVRO_LOCAL_PATH - Static variable in class bdglue2.BDGluePropertyValues
The path on local disk where we can find the avro schemas and/or where they will be written if we generate them.
AVRO_NAMESPACE - Static variable in class bdglue2.BDGluePropertyValues
The namespace to use in avro schemas if the actual table schema name is not present.
AVRO_SCHEMA_URL - Static variable in class bdglue2.BDGluePropertyValues
The URL in HDFS where Avro schemas can be found.
AVRO_URL - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The URL (path) where the target database (i.e.
AvroBoolean - Class in bdglue2.encoder.avro.column
Methods supporting Boolean data.
AvroColumn - Class in bdglue2.encoder.avro.column
This abstract class stores meta data about the columns that we are processing / encoding for transport.
AvroColumn(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroColumn
 
AvroColumnType - Enum in bdglue2.encoder.avro.column
These are the types of columns that we are currently supporting.
AvroDateTime - Class in bdglue2.encoder.avro.column
Methods supporting Date and Time columns.
AvroDateTime(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroDateTime
 
AvroDouble - Class in bdglue2.encoder.avro.column
Methods supporting Double length floating point data.
AvroDouble(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroDouble
 
AvroEncoder - Class in bdglue2.encoder
Encodes the data as an Avro record before sending it downstream for publishing.
AvroEncoder() - Constructor for class bdglue2.encoder.AvroEncoder
 
AvroFloat - Class in bdglue2.encoder.avro.column
Methods supporting Floating point data.
AvroFloat(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroFloat
 
AvroGenericRecordEncoder - Class in bdglue2.encoder
 
AvroGenericRecordEncoder() - Constructor for class bdglue2.encoder.AvroGenericRecordEncoder
 
AvroInteger - Class in bdglue2.encoder.avro.column
Methods supporing Integer columns.
AvroInteger(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroInteger
 
AvroLOB - Class in bdglue2.encoder.avro.column
Methods supporting data that should be treated as LOBs.
AvroLOB(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroLOB
 
AvroLong - Class in bdglue2.encoder.avro.column
Methods supporting Long integer data.
AvroLong(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroLong
 
AvroMultiByte - Class in bdglue2.encoder.avro.column
Methods supporting multi-byte string data (i.e.
AvroMultiByte(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroMultiByte
 
AvroNumeric - Class in bdglue2.encoder.avro.column
Methods supporting "numeric" values whose actual type must be determined on the fly.
AvroNumeric(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroNumeric
 
AvroSchema - Class in bdglue2.encoder.avro
This class keeps up with the avro-related meta data that we care about for processing.
AvroSchema(String, DownstreamTableMetaData, boolean) - Constructor for class bdglue2.encoder.avro.AvroSchema
Construct the internal representation of the Avro schema.
AvroSchemaFactory - Class in bdglue2.encoder.avro
This is a factory object to provide an easy way to track and access the schema meta data that we are collecting.
avroSchemaType - Variable in class bdglue2.encoder.avro.column.AvroColumn
 
AvroString - Class in bdglue2.encoder.avro.column
Methods supporting String-based column data.
AvroString(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroString
 
AvroUnsupported - Class in bdglue2.encoder.avro.column
Methods dealing with column types we don't (presently) support.
AvroUnsupported(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroUnsupported
 
avroURL - Static variable in class bdglue2.encoder.EventHeader
 

B

baos() - Method in class bdglue2.utility.schemadef.Format
Get the output stream we will be writing to.
BATCH_SIZE_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The Flume event property that sets the batch size for writes to Kafka.
bdglue2 - package bdglue2
 
bdglue2.common - package bdglue2.common
 
bdglue2.encoder - package bdglue2.encoder
 
bdglue2.encoder.avro - package bdglue2.encoder.avro
 
bdglue2.encoder.avro.column - package bdglue2.encoder.avro.column
 
bdglue2.meta - package bdglue2.meta
 
bdglue2.meta.schema - package bdglue2.meta.schema
 
bdglue2.meta.transaction - package bdglue2.meta.transaction
 
bdglue2.publisher - package bdglue2.publisher
 
bdglue2.publisher.asynchbase - package bdglue2.publisher.asynchbase
 
bdglue2.publisher.bigquery - package bdglue2.publisher.bigquery
 
bdglue2.publisher.cassandra - package bdglue2.publisher.cassandra
 
bdglue2.publisher.console - package bdglue2.publisher.console
 
bdglue2.publisher.flume - package bdglue2.publisher.flume
 
bdglue2.publisher.hbase - package bdglue2.publisher.hbase
 
bdglue2.publisher.kafka - package bdglue2.publisher.kafka
 
bdglue2.publisher.nosql - package bdglue2.publisher.nosql
 
bdglue2.source.gghadoop - package bdglue2.source.gghadoop
 
bdglue2.utility - package bdglue2.utility
 
bdglue2.utility.schemadef - package bdglue2.utility.schemadef
 
BDGLUE_PROPERTY_PREFIX - Static variable in class bdglue2.publisher.kafka.KafkaProperties
 
BDGlueEncoder - Interface in bdglue2.encoder
An interface that must be implemented by all BDGlue encoders.
BDGluePropertyValues - Class in bdglue2
This class contains configuration constants used by the Big Data Glue code, including property names and where appropriate the default values to use in the event that a property is not defined.
BDGluePublisher - Interface in bdglue2.publisher
An interface that must be implemented by all Publishers.
BDGlueVersion - Class in bdglue2
A simple class that allows us to store the current version number.
BDGlueVersion() - Constructor for class bdglue2.BDGlueVersion
Track the version number.
BigDataName - Class in bdglue2.utility.schemadef
Utility class responsible for converting invalid table or column names to valid ones.
BigDataName() - Constructor for class bdglue2.utility.schemadef.BigDataName
Instantiate in instance of BigDataName.
BigDataName(String, String, String) - Constructor for class bdglue2.utility.schemadef.BigDataName
Instantiate in instance of BigDataName, using the parameters passed in to configure it as desired.
BIGQUERY_BATCH_SIZE - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
The number of operations to batch together.
BIGQUERY_BATCH_SIZE_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
 
BIGQUERY_DATASET - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
The BigQuery dataset name to connect to.
BIGQUERY_DATASET_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
 
BIGQUERY_FLUSH_FREQ - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
The frequency to flush operations if the batch-size isn't reached.
BIGQUERY_FLUSH_FREQ_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
 
BIGQUERY_INSERT_ONLY - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
Boolean: True if we want to convert deletes and updates into inserts.
BIGQUERY_INSERT_ONLY_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
 
BigQueryPublisher - Class in bdglue2.publisher.bigquery
Publish event data to Google BigQuery..
BigQueryPublisher() - Constructor for class bdglue2.publisher.bigquery.BigQueryPublisher
 
BigQueryPublisherPropertyValues - Class in bdglue2.publisher.bigquery
This class contains configuration constants used by the Big Data Glue BigQuery Publisher, including property names and where appropriate the default values to use in the event that a property is not defined.
BigQueryTable - Class in bdglue2.publisher.bigquery
 
BigQueryTable(Table) - Constructor for class bdglue2.publisher.bigquery.BigQueryTable
Construct an instance that represents this table.
bottom(String) - Method in class bdglue2.utility.schemadef.Format
Format the "bottom" portion of the output file.
bottom(String) - Method in class bdglue2.utility.schemadef.FormatAvro
Format the bottom portion of the Avro schema file.
bottom(String) - Method in class bdglue2.utility.schemadef.FormatCassandra
 
bottom(String) - Method in class bdglue2.utility.schemadef.FormatHiveAvro
Format the bottom of the schema.
bottom(String) - Method in class bdglue2.utility.schemadef.FormatNoSQL
Format the bottom portion of the schema file.
BROKER_LIST - Static variable in class bdglue2.publisher.kafka.KafkaProperties
Property that identifies the Kafka broker list to use when deliverying to Kafka.
BROKER_LIST_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The Flume coniguration property for specifying the broker list to the KafkaSink.

C

cancel() - Method in class bdglue2.encoder.EncoderThread
Call this method to terminate the thread and exit.
cancel() - Method in class bdglue2.encoder.ParallelEncoder
Call this method to terminate the thread and exit.
cancel() - Method in class bdglue2.publisher.ParallelPublisher
Call this method to terminate the thread and exit.
cancel() - Method in class bdglue2.publisher.PublisherThread
Call this method to terminate the thread and exit.
CASSANDRA_BATCH_SIZE - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
The number of operations to batch together.
CASSANDRA_BATCH_SIZE_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
 
CASSANDRA_CONNECT_NODE - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
The node in the Cassandra cluster to connect to.
CASSANDRA_CONNECT_NODE_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
 
CASSANDRA_FLUSH_FREQ - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
The frequency to flush operations if the batch-size isn't reached.
CASSANDRA_FLUSH_FREQ_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
 
CASSANDRA_INSERT_ONLY - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
Boolean: True if we want to convert deletes and updates into inserts.
CASSANDRA_INSERT_ONLY_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
 
CassandraPublisher - Class in bdglue2.publisher.cassandra
Publish event data to Cassandra.
CassandraPublisher() - Constructor for class bdglue2.publisher.cassandra.CassandraPublisher
 
CassandraPublisherPropertyValues - Class in bdglue2.publisher.cassandra
This class contains configuration constants used by the Big Data Glue BigQuery Publisher, including property names and where appropriate the default values to use in the event that a property is not defined.
CassandraTable - Class in bdglue2.publisher.cassandra
 
CassandraTable(Session, String, String) - Constructor for class bdglue2.publisher.cassandra.CassandraTable
Construct an instance that represents this table.
CassandraTable(Session, String) - Constructor for class bdglue2.publisher.cassandra.CassandraTable
Construct an instance that represents this table.
checkCallbacks() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
check the status of the callbacks.
checkForNULL() - Method in class bdglue2.meta.transaction.DownstreamColumnData
This is a bit of a hack ...
cleanup() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Disconnect from the client.
cleanup() - Method in class bdglue2.publisher.asynchbase.AsyncHbasePublisher
Clean up and disconnect from the target.
cleanup() - Method in interface bdglue2.publisher.BDGluePublisher
Close connections and clean up as needed.
cleanup() - Method in class bdglue2.publisher.bigquery.BigQueryPublisher
 
cleanup() - Method in class bdglue2.publisher.bigquery.BigQueryTable
Flush any queued events and clean up timer in preparation for shutdown.
cleanup() - Method in class bdglue2.publisher.cassandra.CassandraPublisher
 
cleanup() - Method in class bdglue2.publisher.console.ConsolePublisher
Clean up.
cleanup() - Method in class bdglue2.publisher.flume.FlumePublisher
Clean up the connection and disconnect.
cleanup() - Method in class bdglue2.publisher.hbase.HBasePublisher
 
cleanup() - Method in class bdglue2.publisher.kafka.KafkaHelper
Disconnect from the producer and clean up.
cleanup() - Method in class bdglue2.publisher.kafka.KafkaPublisher
Clean up and close the connection.
cleanup() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
Disconnect from the producer and clean up.
cleanup() - Method in class bdglue2.publisher.kafka.KafkaRegistryPublisher
Clean up and close the connection.
cleanup() - Method in class bdglue2.publisher.nosql.NoSQLHelper
Disconnect from the KVStore.
cleanup() - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
Perform any cleanup needed before exiting.
cleanup() - Method in class bdglue2.publisher.nosql.NoSQLPublisher
Clean up and disconnect from Oracle NoSQL.
cleanup() - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
Perform any needed cleanup before exiting.
cleanup() - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
Perform all necessary clean up prior to exiting.
clearMessageList() - Method in class bdglue2.publisher.kafka.KafkaHelper
clear the message list.
COLUMN_FAMILY - Static variable in class bdglue2.encoder.EventHeader
 
ColumnInfo - Class in bdglue2.utility.schemadef
Contains meta data about the column we are currently working with.
ColumnInfo() - Constructor for class bdglue2.utility.schemadef.ColumnInfo
 
columnType - Variable in class bdglue2.encoder.avro.column.AvroColumn
 
columnTypeString - Variable in class bdglue2.encoder.avro.column.AvroColumn
 
configure(PropertyManagement) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Configure the class based on the properties for the user exit.
configure(PropertyManagement) - Method in class bdglue2.publisher.kafka.KafkaHelper
Configure the class based on the properties for the user exit.
configure(PropertyManagement) - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
Configure the class based on the properties for the user exit.
configure(PropertyManagement) - Method in class bdglue2.publisher.nosql.NoSQLHelper
Configure the class based on the properties for the user exit.
connect() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Connect to the client.
connect() - Method in class bdglue2.publisher.asynchbase.AsyncHbasePublisher
Connect to HBase.
connect() - Method in interface bdglue2.publisher.BDGluePublisher
Connect to the target.
connect() - Method in class bdglue2.publisher.bigquery.BigQueryPublisher
 
connect() - Method in class bdglue2.publisher.cassandra.CassandraPublisher
 
connect() - Method in class bdglue2.publisher.console.ConsolePublisher
Connect.
connect() - Method in class bdglue2.publisher.flume.FlumePublisher
Connect to Flume.
connect() - Method in class bdglue2.publisher.hbase.HBasePublisher
 
connect() - Method in class bdglue2.publisher.kafka.KafkaHelper
connect to the Kafka producer.
connect() - Method in class bdglue2.publisher.kafka.KafkaPublisher
Connect to Kafka.
connect() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
connect to the Kafka producer.
connect() - Method in class bdglue2.publisher.kafka.KafkaRegistryPublisher
Connect to Kafka.
connect() - Method in class bdglue2.publisher.nosql.NoSQLHelper
Connect to the NoSQL KVStore.
connect() - Method in class bdglue2.publisher.nosql.NoSQLPublisher
Connect to Oracle NoSQL.
ConsolePublisher - Class in bdglue2.publisher.console
A simple publisher that writes all data to the console (i.e.
ConsolePublisher() - Constructor for class bdglue2.publisher.console.ConsolePublisher
 
containsTable(String) - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
Determine if we have already added this table to the meta data we are managing.
createRowToInsert(DownstreamOperation) - Method in class bdglue2.publisher.bigquery.BigQueryTable
Create a row for this operation and return it.

D

DEFAULT_BATCH_SIZE - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The default batch size.
DEFAULT_BATCHSIZE - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
The default batchSize to use.
DEFAULT_FLUSH_FREQ - Static variable in class bdglue2.publisher.kafka.KafkaProperties
Force flush of accumulated records after ths number of milliseconds in low volume situations where batch size has note yet been met.
DEFAULT_KEY_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The default serializer for the Kafka partitioning key.
DEFAULT_MESSAGE_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The default message serializer to use when writing the event body.
DEFAULT_REQUIRED_ACKS - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The default value for requiring acks from Kafka after write.
DEFAULT_TIMEOUT - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
The default timeout to use.
DEFAULT_TOPIC - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The default topic to publish to in the event that one is not specified.
defaultProperties - Static variable in class bdglue2.BDGluePropertyValues
The name of the default properties "resource" to look for.
defaultProperties - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
 
DELETE_ID - Static variable in class bdglue2.meta.transaction.DownstreamOperation
 
DELETE_VALUE - Static variable in class bdglue2.meta.transaction.DownstreamOperation
 
DelimitedTextEncoder - Class in bdglue2.encoder
Encodes the operation as delimited text.
DelimitedTextEncoder() - Constructor for class bdglue2.encoder.DelimitedTextEncoder
 
destroy() - Method in class bdglue2.source.gghadoop.GG12Handler
Clean up on exit as the handler is being destroyed.
DownstreamColumnData - Class in bdglue2.meta.transaction
Class that contains the data captured for a column.
DownstreamColumnData(String, String, byte[], boolean) - Constructor for class bdglue2.meta.transaction.DownstreamColumnData
Construct an object that contains the data associated with a particular column that we will be processing.
DownstreamColumnMetaData - Class in bdglue2.meta.schema
Column meta data containing only the info we need downstream for processing.
DownstreamColumnMetaData(String, boolean, boolean, int) - Constructor for class bdglue2.meta.schema.DownstreamColumnMetaData
Build an instance of this class from the supplied column meta data.
DownstreamOperation - Class in bdglue2.meta.transaction
The data that represents the operation type for this record.
DownstreamOperation(String, String, String, String, String, DownstreamTableMetaData) - Constructor for class bdglue2.meta.transaction.DownstreamOperation
Create an operation to pass along for processing from the supplied meta data.
DownstreamSchemaMetaData - Class in bdglue2.meta.schema
A container class holding the meta data for all of the tables that have been mapped.
DownstreamSchemaMetaData() - Constructor for class bdglue2.meta.schema.DownstreamSchemaMetaData
 
DownstreamTableMetaData - Class in bdglue2.meta.schema
A reduced subset of TableMetaData information that only contains the data that we care about downstream.
DownstreamTableMetaData(String, String, String) - Constructor for class bdglue2.meta.schema.DownstreamTableMetaData
Create a table from the given meta data.
drainTo(Collection<T>) - Method in class bdglue2.encoder.EventQueue
Drain the queue to the specified collection.

E

encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.AvroEncoder
Loop through operation to put data into a record.
encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.AvroGenericRecordEncoder
Loop through operation to put data into a record.
encodeDatabaseOperation(DownstreamOperation) - Method in interface bdglue2.encoder.BDGlueEncoder
 
encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.DelimitedTextEncoder
Put the columns into delimited text format for output.
encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.JsonEncoder
Encode the DownstreamOperation as a JSON record.
encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.NullEncoder
Perform no encoding of the DownstreamOperation.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroBoolean
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroColumn
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroDateTime
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroDouble
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroFloat
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroInteger
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroLOB
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroLong
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroMultiByte
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroNumeric
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroString
Encode the data for this column.
encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroUnsupported
Encode the data for this column.
ENCODER_CLASS - Static variable in class bdglue2.BDGluePropertyValues
The class name of encoder we will utilize: AvroEncoder, JsonEncoder, etc.
ENCODER_DELIMITER - Static variable in class bdglue2.BDGluePropertyValues
The delimiter to use in Delimited Text encoding.
ENCODER_DELIMITER_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
the default delimiter to use if one is not specified.
ENCODER_THREADS - Static variable in class bdglue2.BDGluePropertyValues
The number of threads to have executing the encoding process.
ENCODER_THREADS_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
The default number of encoder threads.
EncoderFactory - Class in bdglue2.encoder
A factory class that instantiates encoders of the type specified in the properties file on request.
EncoderFactory() - Constructor for class bdglue2.encoder.EncoderFactory
 
encoderFactory() - Static method in class bdglue2.encoder.EncoderFactory
Creates an instance of the class specified in the properties file.
encoderInputQueueSize - Static variable in class bdglue2.encoder.EventQueue
 
encoderOutputQueueSize - Static variable in class bdglue2.encoder.EventQueue
 
EncoderThread - Class in bdglue2.encoder
A class that manages the individual encoders that get instantiated for the encoder pool.
EncoderThread() - Constructor for class bdglue2.encoder.EncoderThread
 
EncoderThread(String) - Constructor for class bdglue2.encoder.EncoderThread
Create an instance with this thread name.
encoderType - Variable in class bdglue2.encoder.AvroEncoder
 
EncoderType - Enum in bdglue2.encoder
An enumeration that lists the encoder types that are inerently part of BDGlue, and provides an option to identify a custom encoder.
escapeChars(String) - Static method in class bdglue2.encoder.TextEncoderHelper
Escape any characters in the string that need escaping.
eventBody(Object) - Method in class bdglue2.encoder.EventData
Set the event body for this event.
eventBody() - Method in class bdglue2.encoder.EventData
Return the body of the event as the Object that was passed into the constructor.
EventData - Class in bdglue2.encoder
This class represents the output of the encoding process.
EventData() - Constructor for class bdglue2.encoder.EventData
 
EventData(EncoderType, Map<String, String>, Object) - Constructor for class bdglue2.encoder.EventData
Construct an event based on the provided meta data and body.
eventHeader - Variable in class bdglue2.encoder.AvroEncoder
 
EventHeader - Class in bdglue2.encoder
A class for manageing the event header / meta information.
EventHeader() - Constructor for class bdglue2.encoder.EventHeader
 
EventQueue<T> - Class in bdglue2.encoder
A class that manages a queue of events for processing.
EventQueue(String, int) - Constructor for class bdglue2.encoder.EventQueue
Create a queue for managing EventData.
externalProperties - Static variable in class bdglue2.BDGluePropertyValues
The external properties file to look for.
externalProperties - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
 

F

FLUME_HOST - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The name of the target host that we will connect to.
FLUME_HOST_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The default target host name.
FLUME_PORT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The port number on the target host that we will connect to.
FLUME_PORT_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The default target port number.
FLUME_PROPERTY_PREFIX - Static variable in class bdglue2.publisher.kafka.KafkaProperties
 
FLUME_RPC_RETRIES - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
number of times to try to reconnect on RPC connection failure.
FLUME_RPC_RETRY_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
the default number of times to retry a lost connection.
FLUME_RPC_RETRY_DELAY - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The number of seconds to pause between each RPC connection retry.
FLUME_RPC_RETRY_DELAY_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The default amount of time to pause before retrying a failed attempt to connect.
FLUME_RPC_TYPE - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The type or RPC connection: avro-rpc, thrift-rpc.
FLUME_RPC_TYPE_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
The default RPC_TYPE.
FlumePublisher - Class in bdglue2.publisher.flume
An implementation of Publisher to communicate to Flume.
FlumePublisher() - Constructor for class bdglue2.publisher.flume.FlumePublisher
 
FlumePublisherPropertyValues - Class in bdglue2.publisher.flume
This class contains configuration constants used by the Big Data Glue Flume Publisher, including property names and where appropriate the default values to use in the event that a property is not defined.
forceShutdown(String) - Static method in class bdglue2.encoder.ParallelEncoder
Static function that decouples downstream callers from the upstream handler.
format() - Method in class bdglue2.BDGlueVersion
Format the version information.
Format - Class in bdglue2.utility.schemadef
Base class for the schema formaters that we support.
Format() - Constructor for class bdglue2.utility.schemadef.Format
 
FormatAvro - Class in bdglue2.utility.schemadef
Format the column meta data as an Avro schema.
FormatAvro() - Constructor for class bdglue2.utility.schemadef.FormatAvro
 
FormatCassandra - Class in bdglue2.utility.schemadef
Format the Cassandra schema meta data.
FormatCassandra() - Constructor for class bdglue2.utility.schemadef.FormatCassandra
 
FormatHiveAvro - Class in bdglue2.utility.schemadef
Format the Hive schema meta data based on the assumption that we will be storing data in HDFS as Avro files.
FormatHiveAvro() - Constructor for class bdglue2.utility.schemadef.FormatHiveAvro
 
FormatNoSQL - Class in bdglue2.utility.schemadef
Format the metadata for this table as "ddl" for the Oracle NoSQL database's "table" API.
FormatNoSQL() - Constructor for class bdglue2.utility.schemadef.FormatNoSQL
 

G

GENERATE_AVRO_SCHEMA - Static variable in class bdglue2.BDGluePropertyValues
boolean on whether or not to generate the avro schema on the fly.
generateFieldDoc(boolean, String) - Method in class bdglue2.encoder.avro.AvroSchema
Generate the String used to populate the "doc" property for a column.
getAPIType() - Method in class bdglue2.publisher.nosql.NoSQLHelper
 
getAvroColumn(String) - Method in class bdglue2.encoder.avro.AvroSchema
Return the meta data we are tracking for this column.
getAvroSchema() - Method in class bdglue2.encoder.avro.AvroSchema
Get the avro schema.
getAvroSchema(String) - Method in class bdglue2.encoder.avro.AvroSchemaFactory
Locate the AvroSchema object associated with the table we are processing.
getAvroSchemaFactory() - Static method in class bdglue2.encoder.avro.AvroSchemaFactory
Singleton Getter of the factory object.
getBatchSize() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
 
getBDColumnName() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
Get the column name in an appropriate format for big data targets, which don't support special characters.
getBDLongTableName() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
Get the "long" (schema.table) version of the table name, which in some cases could very well be the same as the short name.
getBDName() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Get the name of this column in a "Big Data Friendly" format.
getBDTableName() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
Get the "short" name of this table.
getBefores() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the before image column information associated with this operation and return it as an ArrayList.
getBoundStatement(DownstreamOperation, boolean) - Method in class bdglue2.publisher.cassandra.CassandraTable
Create a bound statement for this operation and return it.
getBuffer() - Method in class bdglue2.utility.schemadef.Format
Get the output stream as a String.
getColumn(String) - Method in class bdglue2.meta.schema.DownstreamTableMetaData
Find the meta data for the requested column.
getColumns() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
Get the columns for this table as an array.
getColumns() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the column information associated with this operation and return it as an ArrayList.
getColumnType() - Method in class bdglue2.encoder.avro.column.AvroColumn
 
getColumnTypeString() - Method in class bdglue2.encoder.avro.column.AvroColumn
 
getDBConnection() - Method in class bdglue2.utility.schemadef.SchemaDef
Get a JDBC connection to the database.
getDefaultValue() - Method in class bdglue2.utility.schemadef.ColumnInfo
Get the default value for this column.
getEncoderType() - Method in class bdglue2.encoder.AvroEncoder
Return the EncoderType.
getEncoderType() - Method in interface bdglue2.encoder.BDGlueEncoder
 
getEncoderType() - Method in class bdglue2.encoder.DelimitedTextEncoder
Returns the EncoderType.
getEncoderType() - Static method in class bdglue2.encoder.EncoderFactory
Return the EncoderType for specified encoder.
getEncoderType() - Method in class bdglue2.encoder.EventData
Get the encoder type we used to create this event.
getEncoderType() - Method in class bdglue2.encoder.JsonEncoder
Get the EncoderType.
getEncoderType() - Method in class bdglue2.encoder.NullEncoder
 
getEventHeader() - Method in class bdglue2.encoder.EventHeader
 
getFieldSchema() - Method in class bdglue2.encoder.avro.column.AvroColumn
Set all columns marked as nullable this way, including key columns.
getHeaders() - Method in class bdglue2.encoder.EventData
Get the header information for this operation.
getIncrements() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
 
getJdbcType() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
Get the type associated with this column.
getJdbcType() - Method in class bdglue2.utility.schemadef.ColumnInfo
Get the jdbc type for this column as an integer.
getKafkaBatchSize() - Static method in class bdglue2.publisher.kafka.KafkaProperties
Get the batch size from the properties.
getKafkaBDGlueProperties() - Static method in class bdglue2.publisher.kafka.KafkaProperties
Get the Kafka properties as configured by BDGlue.
getKafkaFlushFreq() - Static method in class bdglue2.publisher.kafka.KafkaProperties
Get the flush frequency from the properties.
getKafkaTopic() - Static method in class bdglue2.publisher.kafka.KafkaProperties
Get the name of the Kafka topic from the properties.
getKey(String) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
Convert the String representation of the key into a proper instance of a NoSQL Key.
getKeyName() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
Get the "key" value for this table that is used to locate it in the Set of tables we are managing.
getKeyName() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the table name to which this operation pertains and which is used as a key to locate the meta data.
getKeyNames() - Method in class bdglue2.common.PropertyManagement
Get a list of all of the property names.
getKVStore() - Method in class bdglue2.publisher.nosql.NoSQLHelper
 
getLongTableName() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the long table name to which this operation pertains.
getMessageKey(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
 
getMessageKey(EventData) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
Get the message key for this message and return it to the KafkaPublisher.
getMessageKey(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
 
getMessageKey(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
 
getMetadataCols() - Method in class bdglue2.encoder.MetadataHelper
Return a Set that contains the names of the metadata columns that have been configured in the properties file.
getMetadataCols() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the metadata column names as configured in the properties file.
getMetadataHelper() - Static method in class bdglue2.encoder.MetadataHelper
Get the metadata helper.
getMetaValue(String) - Method in class bdglue2.encoder.EventData
Return the value of the specified key from the operation's meta information.
getName() - Method in class bdglue2.utility.schemadef.ColumnInfo
Get the column name.
getOpMetadata(DownstreamOperation) - Method in class bdglue2.encoder.MetadataHelper
Create a Map containing the metadata columns that we want to include with this operation.
getOpMetadata() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the metadata column data for this operation as configured in the properties file.
getOpType() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the operation type that was passed into the constructor.
getOpTypeId() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the operation type as an integer that may be more efficient in case statements downstream.
getOrigColumnName() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
Get the original column name.
getOrigName() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Get the original column name.
getPosition() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the relative position of this operation from the source.
getProducer() - Method in class bdglue2.publisher.kafka.KafkaHelper
 
getProducer() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
 
getProperties(String, String) - Static method in class bdglue2.common.PropertyManagement
Typically, we want a singleton in our application that will hold all of our properties.
getProperties() - Static method in class bdglue2.common.PropertyManagement
Return the singleton instance.
getProperties() - Method in class bdglue2.utility.schemadef.Format
Get the properties for the utility.
getProperty(String) - Method in class bdglue2.common.PropertyManagement
Get the value of the specified property.
getProperty(String, String) - Method in class bdglue2.common.PropertyManagement
Get the value of the specified property, setting a default value if the property has not been intitialized.
getPropertySubset(String, boolean) - Method in class bdglue2.common.PropertyManagement
Return a subset of the properties that begin with "prefix".
getRowKey() - Method in class bdglue2.meta.transaction.DownstreamOperation
Create a contcatenation of the key columns into a single String, separating each value from the one preceding it with a '/'.
getRPCType() - Method in class bdglue2.publisher.flume.FlumePublisher
Get the type of RPC connection we are supposed to make.
getSchemaFileName() - Method in class bdglue2.encoder.avro.AvroSchema
Get the name of the avro schema file we want to read or write.
getSchemaFilePath() - Method in class bdglue2.encoder.avro.AvroSchema
Generate path + fileName for reading or writing an avro schema.
getSchemaId() - Method in class bdglue2.encoder.avro.AvroSchema
 
getTable(String) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
Get the KV Table object for this event.
getTableMeta() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the table meta data that corresponds to this operation.
getTableMetadata() - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
Get the meta data for this table as a Set.
getTableMetaData(String) - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
Get the meta data for an individual table.
getTableName() - Method in class bdglue2.encoder.avro.AvroSchema
Get the name of this table.
getTableName() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the short table name to which this operation pertains.
getTimeStamp() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the transaction timestamp that was passed into the constructor.
getTopic(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
 
getTopic(EventData) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
Get the token for this message and return it to the KafkaPublisher.
getTopic(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
 
getTopic(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
 
getTxId() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get the transaction ID that was passed into the constructor.
getType() - Method in class bdglue2.utility.schemadef.ColumnInfo
Get the type of column (string, integer, float, etc.).
getUserTokens() - Method in class bdglue2.meta.transaction.DownstreamOperation
Get any runtime supplied meta data.
getValue(String, byte[]) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
Store the body of the event as the value of the key.
GG12Handler - Class in bdglue2.source.gghadoop
Subclass of AbstractHandler class as defined by the GoldenGate Java User Exit documentation.
GG12Handler(TxOpMode) - Constructor for class bdglue2.source.gghadoop.GG12Handler
Construct a handler using the specified operation mode.
GG12Handler() - Constructor for class bdglue2.source.gghadoop.GG12Handler
Construct the handler defaulting to operation (op) mode; Setters should be called if needed to set additional properties on the handler.
GG12HandlerMapper - Class in bdglue2.source.gghadoop
This class essentially takes care of mapping the classes that are defined and used by the GoldenGate Java Adapter to the classes that are used by BDGlue.
GG12HandlerMapper() - Constructor for class bdglue2.source.gghadoop.GG12HandlerMapper
 

H

HBasePublisher - Class in bdglue2.publisher.hbase
This is a BDGlue Publisher coded to support the HBase 1.0 API.
HBasePublisher() - Constructor for class bdglue2.publisher.hbase.HBasePublisher
 
HEADER_AVROPATH - Static variable in class bdglue2.BDGluePropertyValues
Boolean as to whether or not to include the path to the Avro schema file in the header.
HEADER_COLUMNFAMIILY - Static variable in class bdglue2.BDGluePropertyValues
Boolean as to whether or not to include a "columnFamily" value in the header.
HEADER_LONGNAME - Static variable in class bdglue2.BDGluePropertyValues
Boolean as to whether or not to include the "long" table name in the header.
HEADER_OPTYPE - Static variable in class bdglue2.BDGluePropertyValues
Boolean as to whether or not to include the operation type in the event header information.
HEADER_ROWKEY - Static variable in class bdglue2.BDGluePropertyValues
Boolean as to whether or not to include a value for the row's key as a concatenation of the key columns in the event header information.
HEADER_TIMESTAMP - Static variable in class bdglue2.BDGluePropertyValues
Boolean as to whether or not to include the transaction timestamp in the event header information.
helperFactory(String) - Static method in class bdglue2.publisher.nosql.NoSQLHelper
A factory methoid that returns an instance of the appropriate subclass.

I

IGNORE_UNCHANGED - Static variable in class bdglue2.BDGluePropertyValues
Boolean: true = ignore operations where data is unchagned.
IGNORE_UNCHANGED_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
The default value for IGNORE_UNCHANGED.
INCLUDE_BEFORES - Static variable in class bdglue2.BDGluePropertyValues
Send before images of data along.
INCLUDE_BEFORES_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
The default value for INCLUDE_BEFORES.
init() - Method in class bdglue2.encoder.ParallelEncoder
Initializes the ecoder with the specified number of Threads, etc.
init() - Method in class bdglue2.publisher.PublisherThread
(Re)initialize this thread and create the Publisher.
init(DsConfiguration, DsMetaData) - Method in class bdglue2.source.gghadoop.GG12Handler
Initialize the base class and then do any other additional initialization specific to this user exit.
init() - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
Create the appropriate encoder and initialize.
init() - Method in class bdglue2.utility.schemadef.FormatAvro
Reinitialize so we can use this again.
init() - Method in class bdglue2.utility.schemadef.FormatCassandra
Reset so we can use this again.
init() - Method in class bdglue2.utility.schemadef.FormatHiveAvro
Reset so we can use this again.
init() - Method in class bdglue2.utility.schemadef.FormatNoSQL
Reset things so we can reuse this instance.
initialize() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Perform any needed initialization.
initialize() - Method in class bdglue2.publisher.kafka.KafkaHelper
Perform any needed initialization.
initialize() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
Perform any needed initialization.
initialize() - Method in class bdglue2.publisher.nosql.NoSQLHelper
Perform any needed initialization of the serializer.
initialize() - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
Perform any needed initialization of this event serializer.
initialize() - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
Perform any needed initialization.
initializeCallbacks() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Initialize the callbacks for this transaction.
INSERT_ID - Static variable in class bdglue2.meta.transaction.DownstreamOperation
 
INSERT_VALUE - Static variable in class bdglue2.meta.transaction.DownstreamOperation
 
INVALID_ID - Static variable in class bdglue2.meta.transaction.DownstreamOperation
 
isDataChanged() - Method in class bdglue2.meta.transaction.DownstreamOperation
Compares the before and after images of update operations and returns true if all of the column values in the after image (which may not be a complete column list) DO NOT match the corresponding values in the before image.
isKeyCol() - Method in class bdglue2.encoder.avro.column.AvroColumn
 
isKeyCol() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
Is this a key column?
isKeyCol() - Method in class bdglue2.meta.transaction.DownstreamColumnData
Is this a key column?
isKeyCol() - Method in class bdglue2.utility.schemadef.ColumnInfo
Indicate whether or not this is a key column.
isNullable() - Method in class bdglue2.encoder.avro.column.AvroColumn
 
isNullable() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
Can this column be null?
isNullable() - Method in class bdglue2.utility.schemadef.ColumnInfo
Indicate if this column can be null.

J

JDBC_DRIVER - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The JDBC driver.
JDBC_PASSWORD - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The User Name for the JDBC connection to the database.
JDBC_TABLES - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The list of tables to generate meta data for.
JDBC_URL - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The URL for the JDBC connection to the database.
JDBC_USER - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The User Name for the JDBC connection to the database.
JSON_TEXT - Static variable in class bdglue2.BDGluePropertyValues
true = generate all json value fields as text strings.
JSON_TEXT_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
The default value for JSON_TEXT.
JsonEncoder - Class in bdglue2.encoder
A class to encode data in a JSON format where field names correspond to input field names, and values contain the data values for the fields.
JsonEncoder() - Constructor for class bdglue2.encoder.JsonEncoder
 
JsonEncoder(boolean) - Constructor for class bdglue2.encoder.JsonEncoder
 

K

KAFKA_BATCH_SIZE - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
The batchize used for writes to Kafka.
KAFKA_BROKER_LIST - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
A comma separated list of Kakfa brokers.
KAFKA_FLUSH_FREQ - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
The frequency to flush data if the batch size specified hasn't been reached.
KAFKA_KEY_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
Used to override the default serializer for Kafka event keys.
KAFKA_MESSAGE_METADATA - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
A class that implements KafkaMessageHelper to return token/message key info.
KAFKA_MESSAGE_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
Used to override the default serializer for Kafka event payloads.
KAFKA_REGISTRY_ID_SIZE - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
The lenght of the id field to add to a serialized message.
KAFKA_REGISTRY_MAGIC_BYTE - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
The magic byte to add to a serialized message.
KAFKA_REGISTRY_MAX_SCHEMAS - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
The maximum schemas per subject to store.
KAFKA_REGISTRY_URL - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
URL where we can find the registry.
KAFKA_REQUIRED_ACKS - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
Tell the producer to require an acknowledgement from the Broker that a message was received.
KAFKA_TOPIC - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
A default Kafka topic.
KafkaHelper - Class in bdglue2.publisher.kafka
A helper class that contains common functionality leveraged by both the Flume KafkaSink and by the KafkaPulisher.
KafkaHelper() - Constructor for class bdglue2.publisher.kafka.KafkaHelper
 
KafkaMessageDefaultMeta - Class in bdglue2.publisher.kafka
Default class for getting metadata for the Kafka message.
KafkaMessageDefaultMeta() - Constructor for class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
 
KafkaMessageHelper - Interface in bdglue2.publisher.kafka
A simple interface used for defining helper classes that allow for custom logic for defining Kafka message Topics and Keys.
KafkaMessageTableKey - Class in bdglue2.publisher.kafka
Return the table name as the topic, and a representation of the primary key as the Kafka message key.
KafkaMessageTableKey() - Constructor for class bdglue2.publisher.kafka.KafkaMessageTableKey
 
KafkaMessageTableKeyBb - Class in bdglue2.publisher.kafka
Return the short table name as the topic, and a representation of the primary key as the Kafka message key, prefixed by the schema name.
KafkaMessageTableKeyBb() - Constructor for class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
 
KafkaProperties - Class in bdglue2.publisher.kafka
Inspired by org.apache.flume.sink.kafka.KafkaSinkConstants.
KafkaProperties() - Constructor for class bdglue2.publisher.kafka.KafkaProperties
 
KafkaPublisher - Class in bdglue2.publisher.kafka
Publish event data to Kafka.
KafkaPublisher() - Constructor for class bdglue2.publisher.kafka.KafkaPublisher
 
KafkaPublisherPropertyValues - Class in bdglue2.publisher.kafka
This class contains configuration constants used by the Big Data Glue Kafka Publisher, including property names and where appropriate the default values to use in the event that a property is not defined.
KafkaRegistry - Class in bdglue2.publisher.kafka
 
KafkaRegistry() - Constructor for class bdglue2.publisher.kafka.KafkaRegistry
 
KafkaRegistryHelper - Class in bdglue2.publisher.kafka
A helper class that contains functionality needed by the KafkaRegistryPulisher.
KafkaRegistryHelper() - Constructor for class bdglue2.publisher.kafka.KafkaRegistryHelper
 
KafkaRegistryPublisher - Class in bdglue2.publisher.kafka
 
KafkaRegistryPublisher() - Constructor for class bdglue2.publisher.kafka.KafkaRegistryPublisher
 
KEY_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaProperties
Property that identifies the serializer to use for writing the Kafka partitioning key value.

L

loadProperties(String, String) - Method in class bdglue2.common.PropertyManagement
Load the properties from their storage locations.
LOCATION - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The URL (path) where the target database (i.e.
logConfiguration() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
log the configuratoin settings.
logConfiguration() - Method in class bdglue2.publisher.kafka.KafkaHelper
Log the configuraton information.
logConfiguration() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
Log the configuraton information.
logConfiguration() - Method in class bdglue2.publisher.nosql.NoSQLHelper
Log the configuraiton information.

M

main(String[]) - Static method in class bdglue2.BDGlueVersion
Main entry point to return the version information.
main(String[]) - Static method in class bdglue2.utility.schemadef.SchemaDef
Main entry point for this utility.
MESSAGE_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaProperties
Property that identifies the serializer to use for writing the Kafka event body.
messageList() - Method in class bdglue2.publisher.kafka.KafkaHelper
 
metaDataChanged(DownstreamSchemaMetaData) - Method in class bdglue2.encoder.avro.AvroSchemaFactory
Process the metadata for the table(s) in the meta data.
metaDataChanged(DownstreamTableMetaData) - Method in class bdglue2.encoder.avro.AvroSchemaFactory
Process the metadata for the new/changed table.
metaDataChanged(DsEvent, DsMetaData) - Method in class bdglue2.source.gghadoop.GG12Handler
New metadata received for an object.
metaDataChanged(TableMetaData) - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
Process the metadata for a table and tell BDGlue about it.
MetadataHelper - Class in bdglue2.encoder
This class helps deterimine what metadata should be encoded into any record.

N

newAvroColumn(DownstreamColumnMetaData) - Static method in class bdglue2.encoder.avro.column.AvroColumn
Static factory class.
NEWLINE_CHAR - Static variable in class bdglue2.BDGluePropertyValues
Replace newline characters in string fields with this character.
NOSQL_API - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
Specify whether to use the KV or Table API when writing to NoSQL.
NOSQL_API_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The default NoSQL API to use if one isn't specified.
NOSQL_DURABILITY - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The durability model for NoSQL transactions.
NOSQL_DURABILITY_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The default NoSQL durability model.
NOSQL_HOST - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The name of the NoSQL host.
NOSQL_HOST_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The default host to connect to if one isn't specified.
NOSQL_KVSTORE - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The name of the NoSQL KVStore.
NOSQL_KVSTORE_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The default NoSQL datastore name.
NOSQL_PORT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The port where NoSQL is listening.
NOSQL_PORT_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
The default NoSQL port.
NoSQLHelper - Class in bdglue2.publisher.nosql
An abstract class for common code between the NoSQL KV and Table helper classes.
NoSQLHelper() - Constructor for class bdglue2.publisher.nosql.NoSQLHelper
 
NoSQLHelper.API_TYPE - Enum in bdglue2.publisher.nosql
 
NoSQLKVHelper - Class in bdglue2.publisher.nosql
A helper class that contains shared functionality for the NoSQL KV API for Flulme and direct connections.
NoSQLKVHelper() - Constructor for class bdglue2.publisher.nosql.NoSQLKVHelper
 
NoSQLPublisher - Class in bdglue2.publisher.nosql
Publish data to the Oracle NoSQL database.
NoSQLPublisher() - Constructor for class bdglue2.publisher.nosql.NoSQLPublisher
Create an instance of the Oracl NoSQL publisher for the specified NoSQL API: TABLE or KV.
NoSQLPublisherPropertyValues - Class in bdglue2.publisher.nosql
This class contains configuration constants used by the Big Data Glue NoSQL Publisher, including property names and where appropriate the default values to use in the event that a property is not defined.
NoSQLTableHelper - Class in bdglue2.publisher.nosql
A helper class containing common functionality for the Table API.
NoSQLTableHelper() - Constructor for class bdglue2.publisher.nosql.NoSQLTableHelper
 
NullEncoder - Class in bdglue2.encoder
This class does no encoding of the database operation.
NullEncoder() - Constructor for class bdglue2.encoder.NullEncoder
 
NUMERIC_ENCODING - Static variable in class bdglue2.BDGluePropertyValues
Set the type we should encode numeric/decimal types to.
NUMERIC_ENCODING - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Set the type we should encode numeric/decimal types to.
NUMERIC_ENCODING_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
 
numericEncoding() - Method in class bdglue2.utility.schemadef.SchemaDef
Determine how to encode fixed decimal types.

O

operationAdded(DsEvent, DsTransaction, DsOperation) - Method in class bdglue2.source.gghadoop.GG12Handler
Process this new operation.
OPTYPE - Static variable in class bdglue2.encoder.EventHeader
 
OPTYPE_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The name for the generated optype column.
OUTPUT_FORMAT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The output fomat for the generated files.
OUTPUT_PATH - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The path of the output directory.

P

ParallelEncoder - Class in bdglue2.encoder
A class that manages the encoder thread pool, and itself runs as a thread.
ParallelEncoder() - Constructor for class bdglue2.encoder.ParallelEncoder
construct an encoder with the number of threads specified in the properties for processing.
ParallelEncoder(int) - Constructor for class bdglue2.encoder.ParallelEncoder
Construct an encoder with the specified number of threads for processing.
ParallelPublisher - Class in bdglue2.publisher
A class that manages a pool of publisher threads and itself executes as a thread.
ParallelPublisher() - Constructor for class bdglue2.publisher.ParallelPublisher
construct a Publisher with the defualt number of threads for processing.
ParallelPublisher(int) - Constructor for class bdglue2.publisher.ParallelPublisher
Construct a Publisher with the specified number of threads for processing.
peek() - Method in class bdglue2.encoder.EncoderThread
Take a look at what is next in the queue without removing it, if anything.
peek() - Method in class bdglue2.encoder.EventQueue
Peek at the object at the head of the queue.
populateAvroRecord(AvroSchema, DownstreamOperation, Schema) - Method in class bdglue2.encoder.AvroEncoder
Populate the fields in the Avro record.
POSITION - Static variable in class bdglue2.encoder.EventHeader
 
POSITION_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The name for the generated position column.
printProperties() - Method in class bdglue2.common.PropertyManagement
Print the properties for this instance of PropertyManagement.
printProperties(Properties) - Method in class bdglue2.common.PropertyManagement
Print the properties found in the specified instance of Properties in sorted order.
process(EventData) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Process the received BDGlue event.
process(EventData) - Method in class bdglue2.publisher.kafka.KafkaHelper
Process the received BDGlue event.
process(EventData) - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
Process the received BDGlue event and send to Kafka.
process(EventData) - Method in class bdglue2.publisher.nosql.NoSQLHelper
Process the received BDGlue event.
process(EventData) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
Process the BDGlue event.
process(EventData) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
Process the BDGlue event.
processAvro(Map<String, String>, byte[]) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
Write the event data to NoSQL using the KV API.
processJSON(String, byte[]) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
Parse JSON-encoded event body and write the row to NoSQL.
processOperation(DownstreamOperation) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Iterate through the operation and write to NoSQL.
processOperation(String, DownstreamOperation) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
Iterate through the operation and write to NoSQL.
processOperation(Op) - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
Process the database operation and put it into a form that BDGlue can understand.
PropertyManagement - Class in bdglue2.common
Manage properties for the application.
PropertyManagement(String, String) - Constructor for class bdglue2.common.PropertyManagement
Load the properties from the properties file.
publish(EventData) - Method in class bdglue2.publisher.ParallelPublisher
Route the event to the appropriate PublisherThread for processing.
PUBLISHER_CLASS - Static variable in class bdglue2.BDGluePropertyValues
the name of the implementation of Publisher that should be called.
PUBLISHER_HASH - Static variable in class bdglue2.BDGluePropertyValues
Select publisher thread based on hash of table name or rowkey.
PUBLISHER_THREADS - Static variable in class bdglue2.BDGluePropertyValues
The number of threads to have executing the publishing process.
PUBLISHER_THREADS_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
The default number of publisher threads.
PublisherFactory - Class in bdglue2.publisher
A factory class that creates an instance of the appropriate publisher.
publisherFactory() - Static method in class bdglue2.publisher.PublisherFactory
Return an instance of Publisher that corresponds to the specified TargetType.
publisherQueueSize - Static variable in class bdglue2.encoder.EventQueue
 
PublisherThread - Class in bdglue2.publisher
A class that manages an instance of a Publisher in its own thread.
PublisherThread() - Constructor for class bdglue2.publisher.PublisherThread
Create an instance with the default thread name of "myThread".
PublisherThread(String) - Constructor for class bdglue2.publisher.PublisherThread
Create an instance with this thread name.
publisherThreadQueueSize - Static variable in class bdglue2.encoder.EventQueue
 
PublisherType - Enum in bdglue2.publisher
Enumeration that indicates the type of publisher.
publishEvents() - Method in class bdglue2.publisher.hbase.HBasePublisher
publish all events that we have queued up to Kafka.
publishEvents() - Method in class bdglue2.publisher.kafka.KafkaPublisher
publish all events that we have queued up to Kafka.
put(DownstreamOperation) - Method in class bdglue2.encoder.EncoderThread
Put an input operation on the inputQueue.
put(T) - Method in class bdglue2.encoder.EventQueue
Put an event on this queue.
put(DownstreamOperation) - Method in class bdglue2.encoder.ParallelEncoder
Puts the operation on the input queue for subsequent processing.
put(EventData) - Method in class bdglue2.publisher.ParallelPublisher
Puts the event the appropriate queue for subsequent processing.
put(EventData) - Method in class bdglue2.publisher.PublisherThread
Put an event on the inputQueue.
putColumnFamily(String) - Method in class bdglue2.encoder.EventHeader
Set the column family in the event header.
putHeaderData(String, String) - Method in class bdglue2.encoder.EventHeader
This is header data that will travel along with the encoded record for downstream processing.
putOpType(String) - Method in class bdglue2.encoder.EventHeader
Set the operation type in the event header.
putRowKey(String) - Method in class bdglue2.encoder.EventHeader
Put the key value for the row in the Avro event header.
putSchemaURL(String) - Method in class bdglue2.encoder.EventHeader
Put the URL to the Avro schema file in HDFS in the Avro event header.
putShortName(String) - Method in class bdglue2.encoder.EventHeader
Set the simple table name (i.e.
putTable(String) - Method in class bdglue2.encoder.EventHeader
Set the table name in the Avro event header.
putTimeStamp(String) - Method in class bdglue2.encoder.EventHeader
Put the transaction timestamp in the Avro event header.

Q

quoted(String) - Static method in class bdglue2.encoder.TextEncoderHelper
wrap the input string in quotes, and escape any characters that need escaping.

R

readSchemaFile(String) - Method in class bdglue2.encoder.avro.AvroSchema
Read the JSON formated schema from an avro schema file.
registerSchema(String, Schema) - Method in class bdglue2.publisher.kafka.KafkaRegistry
Register the schema with the kafka schema registry.
REPLACE_CHAR - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Replace special characters that are valid in RDBMS table/column names, but are not valid in hive/hbase/nosql/etc.
REPLACE_CHAR_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The default character to use when replacing invalid characters that are not at the beginning of a field name.
REPLACE_FIRST - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Replace special characters at the beginning of a field name that are valid in RDBMS table/column names, but are not valid in hive/hbase/nosql/etc.
REPLACE_FIRST_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The default character to use when replacing an invalid first character of an field name.
REPLACE_NEWLINE - Static variable in class bdglue2.BDGluePropertyValues
Replace newline characters in string fields with some other character.
REPLACE_NEWLINE_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
The default value for REPLACE_NEWLINE.
REPLACE_REGEX - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Specifies the regular expression to use to identify invalid characters in a field name.
REPLACE_REGEX_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The default regular expression.
REPLICATION_STRATEGY - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The replication strategy for Cassandra.
REPLICATION_STRATEGY_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
 
reportStatus() - Method in class bdglue2.source.gghadoop.GG12Handler
Get the status of this handler.
reportStatus() - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
Report the status of this handler, including all encoder and publisher threads running in BDGlue.
REQUIRED_ACKS - Static variable in class bdglue2.publisher.kafka.KafkaProperties
Property that identifies how to require acks from Kafka.
REQUIRED_ACKS_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The Flume coniguration property for specifying the required acks value to the KafkaSink.
ROWKEY - Static variable in class bdglue2.encoder.EventHeader
 
RPCType - Enum in bdglue2.publisher.flume
Enum identifying which RPC protocol to use when talking to Flume.
run() - Method in class bdglue2.encoder.EncoderThread
Execute the Encoder thread.
run() - Method in class bdglue2.encoder.ParallelEncoder
This is the thread that harvests the encoded events from each of the encoders' queues and sends them onward for publishing.
run() - Method in class bdglue2.publisher.ParallelPublisher
This is the thread that routes the encoded events to the appropriate PublisherThread for delivery.
run() - Method in class bdglue2.publisher.PublisherThread
Run the thread.

S

SCHEMA_ID_UNSET - Static variable in class bdglue2.encoder.avro.AvroSchema
 
SchemaDef - Class in bdglue2.utility.schemadef
A simple tool for generating schema meta data files for the target environment.
SchemaDef() - Constructor for class bdglue2.utility.schemadef.SchemaDef
 
SchemaDefPropertyValues - Class in bdglue2.utility.schemadef
The properties for SchemaDef.
SchemaDefPropertyValues() - Constructor for class bdglue2.utility.schemadef.SchemaDefPropertyValues
 
sendToEncoder(DownstreamOperation) - Method in class bdglue2.encoder.EncoderThread
Convert the input operation into an event.
sendToProducer() - Method in class bdglue2.publisher.kafka.KafkaHelper
Send the messageList to the Kafka Producer.
sendToPublisher(EncoderThread) - Method in class bdglue2.encoder.ParallelEncoder
Pull the next event off of the specified encoder and send it downstream for publishing.
serialize(GenericRecord) - Method in class bdglue2.publisher.kafka.KafkaRegistry
Serialize as appropriate to send a record to Kafka that contains information pertaining to the schema version that applies to this record.
SET_DEFAULTS - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Specify whether to generate default values or not.
SET_OPTYPE - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
specify whether to include a column for the operation type (insert, update, delete).
SET_POSITION - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Specify whether to include a column for the relative position of the op.
SET_TABLENAME - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
specify whether to include a column for the table name
SET_TIMESTAMP - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Specify whether to include a column for the operation timestamp.
SET_TXID - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
specify whether to include a column for a transaction identifier (SCN)
SET_USERTOKEN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
Specify whether to include a column for the operation user tokens.
setAPIType(String) - Method in class bdglue2.publisher.nosql.NoSQLHelper
Set the API type (Table or KV API).
setAvroColumnType(Schema.Type) - Method in class bdglue2.encoder.avro.column.AvroColumn
Override the default avro schema type with whatever value was specified in the *.avsc file we read from disk.
setBdglueTxInfo() - Method in class bdglue2.utility.schemadef.SchemaDef
Create columns for the transaction metadata information including operation type and/or the transaction timestamp, etc.
setColumns(DownstreamOperation, Op) - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
Set the column data values for the current operation.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroBoolean
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroColumn
Set the metadata type and the default Avro schema type for this column.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroDateTime
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroDouble
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroFloat
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroInteger
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroLOB
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroLong
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroMultiByte
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroNumeric
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroString
Set the default values for this column type.
setColumnType() - Method in class bdglue2.encoder.avro.column.AvroUnsupported
Set the default values for this column type.
setDefaultValue(String) - Method in class bdglue2.utility.schemadef.ColumnInfo
Set the default value for the column.
setFileName(String) - Method in class bdglue2.utility.schemadef.Format
Set the name of the target output file.
setFileSuffix(String) - Method in class bdglue2.utility.schemadef.Format
Set the file suffix that identifies the output file type.
setFormat() - Method in class bdglue2.utility.schemadef.SchemaDef
Determine the proper formatter to invoke.
setGG122TxInfo() - Method in class bdglue2.utility.schemadef.SchemaDef
This is a hack specific to GG "out of the box" processing.
setHeaderInfo(DownstreamOperation) - Method in class bdglue2.encoder.EventHeader
Set the Avro event header information for this operation based on the encoder and target types, etc.
setHeaders(Map<String, String>) - Method in class bdglue2.encoder.EventData
Set the meta information in the header for this Event.
setJdbcType(int) - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
Override jdbc type where type mismatch is found at runtime.
setJdbcType(int, String) - Method in class bdglue2.utility.schemadef.ColumnInfo
Set the type for this column based on the incoming parameters.
setKeyCol(boolean) - Method in class bdglue2.utility.schemadef.ColumnInfo
Identify this column as a key column.
setMessageKey(String) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
 
setMessageKey(String) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
Set the message key value in use cases where it will always be the same and not determined dynamically.
setMessageKey(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
 
setMessageKey(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
 
setName(String) - Method in class bdglue2.utility.schemadef.ColumnInfo
Set the column name.
setNullable(String) - Method in class bdglue2.utility.schemadef.ColumnInfo
Indicate whether this column can be null.
setProperty(String, String) - Method in class bdglue2.common.PropertyManagement
Set a property for this environment.
setRowValues(EventData) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
Loop through the data for this operation.
setSchemaId(int) - Method in class bdglue2.encoder.avro.AvroSchema
Set the schema ID.
setTopic(String) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
 
setTopic(String) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
Set the topic value in use cases where it will always be the same and not determined dynamically.
setTopic(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
 
setTopic(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
 
setUserTokens(DsOperation) - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
Return a String containing a comma separated list of user tokens.
SHORT_NAME - Static variable in class bdglue2.encoder.EventHeader
 
shutdown(String) - Static method in class bdglue2.source.gghadoop.GG12Handler
Static function to allow a decision to stop processing to be made anywhere in the BDGlue code.
size() - Method in class bdglue2.encoder.EventQueue
 
status() - Method in class bdglue2.encoder.EncoderThread
Get a snapshot of current statistics for this thread.
status() - Method in class bdglue2.encoder.EventQueue
Return the status of this queue formatted as a String.
status() - Method in class bdglue2.encoder.ParallelEncoder
Generates the status of the encoder as a String.
status() - Method in class bdglue2.publisher.ParallelPublisher
Get the current status of the thread as a String for logging purposes.
status() - Method in class bdglue2.publisher.PublisherThread
 

T

TABLE - Static variable in class bdglue2.encoder.EventHeader
 
TABLENAME - Static variable in class bdglue2.BDGluePropertyValues
boolean: populate table name column.
tablename() - Method in class bdglue2.encoder.MetadataHelper
Determines whether to include the table name in the record.
TABLENAME_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
table name column name to use.
TABLENAME_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The name for the generated tablename column.
tablenameCol() - Method in class bdglue2.encoder.MetadataHelper
The column name to store the table name in.
tables(String) - Method in class bdglue2.utility.schemadef.SchemaDef
Generate an array of table names from a String.
take() - Method in class bdglue2.encoder.EncoderThread
Take an event from the outputQueue and return it.
take() - Method in class bdglue2.encoder.EventQueue
Take an event off of this queue.
TextEncoderHelper - Class in bdglue2.encoder
A helper class that handles basic escaping of special characters that might cause problems when handled downstream.
TextEncoderHelper() - Constructor for class bdglue2.encoder.TextEncoderHelper
 
TIMESTAMP - Static variable in class bdglue2.encoder.EventHeader
 
TIMESTAMP_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The name for the generated timestamp column.
top(String, String, boolean) - Method in class bdglue2.utility.schemadef.Format
Format the "top" portion of the output file.
top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatAvro
Format the top portion of the Avro schema file.
top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatCassandra
Format the top portion of the Cassandra schema file.
top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatHiveAvro
Format the top portion of the Hive schema file.
top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatNoSQL
Format the top portion of the NoSQL Table API schema file.
TOPIC - Static variable in class bdglue2.encoder.EventHeader
 
TOPIC_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
The Flume event property that will contain the topic name.
transactionBegin(DsEvent, DsTransaction) - Method in class bdglue2.source.gghadoop.GG12Handler
Called at the beginning of a transaction.
transactionCommit(DsEvent, DsTransaction) - Method in class bdglue2.source.gghadoop.GG12Handler
If we are in transaction mode (i.e.
transactionRollback(DsEvent, DsTransaction) - Method in class bdglue2.source.gghadoop.GG12Handler
Called if the transaction has to be rolled back for some reason.
TX_OPTYPE - Static variable in class bdglue2.BDGluePropertyValues
boolean: populate operation type column.
TX_OPTYPE_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
op type column name to use.
TX_POSITION - Static variable in class bdglue2.BDGluePropertyValues
boolean: populate transaction relative position column.
TX_POSITION_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
relative position column name to use.
TX_TIMESTAMP - Static variable in class bdglue2.BDGluePropertyValues
boolean: populate transaction timestamp column.
TX_TIMESTAMP_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
timestamp column name to use.
TXID - Static variable in class bdglue2.BDGluePropertyValues
boolean: populate transaction id column.
txId() - Method in class bdglue2.encoder.MetadataHelper
Determines whether to include a transaction identifier in the record.
TXID_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
transaxction id column name to use.
TXID_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The name for the generated transaction ID column.
txIdCol() - Method in class bdglue2.encoder.MetadataHelper
The column name to store the transaction id in.
txOpType() - Method in class bdglue2.encoder.MetadataHelper
Determines whether to include operation type in the record.
txOptypeCol() - Method in class bdglue2.encoder.MetadataHelper
Get the name of the operation type column.
txPosition() - Method in class bdglue2.encoder.MetadataHelper
Determines whether to include position information in the record.
txPositionCol() - Method in class bdglue2.encoder.MetadataHelper
The column name to store relative position data in.
txTimestamp() - Method in class bdglue2.encoder.MetadataHelper
Determines whether to include timestamp information in the record.
txTimestampCol() - Method in class bdglue2.encoder.MetadataHelper
Get the column name for timestamp information.

U

UPDATE_ID - Static variable in class bdglue2.meta.transaction.DownstreamOperation
 
UPDATE_VALUE - Static variable in class bdglue2.meta.transaction.DownstreamOperation
 
USERTOKEN - Static variable in class bdglue2.BDGluePropertyValues
boolean: populate transaction user token column.
userToken() - Method in class bdglue2.encoder.MetadataHelper
Determines whether to include user data (supporting meta data) information in the record.
USERTOKEN_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
user token column name to use.
USERTOKEN_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
The name for the generated user token column.
userTokenCol() - Method in class bdglue2.encoder.MetadataHelper
The column name for token information.

V

validateDirectory(String) - Method in class bdglue2.encoder.avro.AvroSchema
Make sure that the directory exists, and if not, create it.
validateDirectory(String) - Method in class bdglue2.utility.schemadef.Format
Make sure that the directory exists, and if not, create it.
validName(String) - Method in class bdglue2.utility.schemadef.BigDataName
Convert a potentially invalid name to a valid one.
valueOf(String) - Static method in enum bdglue2.encoder.avro.column.AvroColumnType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum bdglue2.encoder.EncoderType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum bdglue2.publisher.flume.RPCType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum bdglue2.publisher.nosql.NoSQLHelper.API_TYPE
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum bdglue2.publisher.PublisherType
Returns the enum constant of this type with the specified name.
values() - Static method in enum bdglue2.encoder.avro.column.AvroColumnType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum bdglue2.encoder.EncoderType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum bdglue2.publisher.flume.RPCType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum bdglue2.publisher.nosql.NoSQLHelper.API_TYPE
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum bdglue2.publisher.PublisherType
Returns an array containing the constants of this enum type, in the order they are declared.
versionInfo() - Method in class bdglue2.BDGlueVersion
Write the version info to stdout.

W

wrapAsEventRecord(Schema) - Method in class bdglue2.encoder.avro.AvroSchema
Wrap schema for a table as an Avro Event prior to output of JSON data.
writeEvent(String, EventData) - Method in class bdglue2.publisher.asynchbase.AsyncHbasePublisher
Write the event to HBase.
writeEvent(String, EventData) - Method in interface bdglue2.publisher.BDGluePublisher
Format the event and write it to the target.
writeEvent(String, EventData) - Method in class bdglue2.publisher.bigquery.BigQueryPublisher
 
writeEvent(String, EventData) - Method in class bdglue2.publisher.cassandra.CassandraPublisher
 
writeEvent(String, EventData) - Method in class bdglue2.publisher.console.ConsolePublisher
Write the data to the console.
writeEvent(String, EventData) - Method in class bdglue2.publisher.flume.FlumePublisher
Write the event data to Flume.
writeEvent(String, EventData) - Method in class bdglue2.publisher.hbase.HBasePublisher
 
writeEvent(String, EventData) - Method in class bdglue2.publisher.kafka.KafkaPublisher
Prepare the event to be writtent to the Kafka topic.
writeEvent(String, EventData) - Method in class bdglue2.publisher.kafka.KafkaRegistryPublisher
Prepare the event to be written to the Kafka topic.
writeEvent(String, EventData) - Method in class bdglue2.publisher.nosql.NoSQLPublisher
Write the event to the appropriate Oracle NoSQL API.
writeField(ColumnInfo, boolean) - Method in class bdglue2.utility.schemadef.Format
Format the fields that make up the "middle" of the output file.
writeField(ColumnInfo, boolean) - Method in class bdglue2.utility.schemadef.FormatAvro
Format each of the fields that represent the columns in the Avro schema file.
writeField(ColumnInfo, boolean) - Method in class bdglue2.utility.schemadef.FormatCassandra
 
writeField(ColumnInfo, boolean) - Method in class bdglue2.utility.schemadef.FormatHiveAvro
Format the "middle" of the schema.
writeField(ColumnInfo, boolean) - Method in class bdglue2.utility.schemadef.FormatNoSQL
Format each of the fields that represent the columns in the NoSQL schema file.
writeSchemaFile(Schema, String, boolean) - Method in class bdglue2.encoder.avro.AvroSchema
Write the generated scheam to a file in JSON format.
writFile() - Method in class bdglue2.utility.schemadef.Format
write the generated file to disk.
A B C D E F G H I J K L M N O P Q R S T U V W 
Skip navigation links

Copyright © 2016–2017. All rights reserved.