- addBefore(DownstreamColumnData) - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Add before image data pertaining to a column to this operation.
- addColumn(DownstreamColumnMetaData) - Method in class bdglue2.meta.schema.DownstreamTableMetaData
-
Add a column to the table's meta data.
- addColumn(DownstreamColumnData) - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Add information pertaining to a column to this operation.
- addTable(String, DownstreamTableMetaData) - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
-
Add this table to the list of tables we are managing, or
replace it if the table is already present in the list.
- asBigDecimal() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Use this for mapping "packed decimal" types.
- asBoolean(String, String) - Method in class bdglue2.common.PropertyManagement
-
Return the requested property as a boolean value, setting a default
value if it hasn't been initialized.
- asBoolean() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Return the data from the String representation of the data
encoded as a boolean value.
- asByteBuffer() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Get the binary value that was given to the constructor
and return it as an instance of ByteBuffer.
- asBytes() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Get the binary value that was given to the constructor
and return it as a byte array.
- asDouble() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Return the value from the String representation
of the field parsed as a double.
- asFloat() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Return the value from the String representaion of
the field parsed as a float.
- asInt(String, String) - Method in class bdglue2.common.PropertyManagement
-
Return the requested property as an integer, setting a default
value if it hasn't been initialized.
- asInteger() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Return the value from the String representation
of the field parsed as an integer.
- asLong() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Return the value from the String representation
of the field parsed as a long.
- asString() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Get the string representation of this column
as a String.
- ASYNC_HBASE_BATCHSIZE - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
-
The batchsize for writing records to HBase.
- ASYNC_HBASE_TIMEOUT - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
-
Timeout value after which asynchronous calls that have not returned
are declared unsuccessful.
- AsyncHbaseHelper - Class in bdglue2.publisher.asynchbase
-
A helper class that contains common funtionality that is
leveraged both by the direct apply functionality
in AsyncHbasePublisher and by the Flume BDGlueAsyncHbaseSink.
- AsyncHbaseHelper() - Constructor for class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
- AsyncHbasePublisher - Class in bdglue2.publisher.asynchbase
-
Publish data to HBase using the Async HBase API.
- AsyncHbasePublisher() - Constructor for class bdglue2.publisher.asynchbase.AsyncHbasePublisher
-
- AsyncHbasePublisherPropertyValues - Class in bdglue2.publisher.asynchbase
-
This class contains configuration constants used by the
Big Data Glue Async Hbase Publisher, including property names and where appropriate
the default values to use in the event that a property
is not defined.
- AVRO_LOCAL_PATH - Static variable in class bdglue2.BDGluePropertyValues
-
The path on local disk where we can find the avro schemas and/or
where they will be written if we generate them.
- AVRO_NAMESPACE - Static variable in class bdglue2.BDGluePropertyValues
-
The namespace to use in avro schemas if the actual table schema name
is not present.
- AVRO_SCHEMA_URL - Static variable in class bdglue2.BDGluePropertyValues
-
The URL in HDFS where Avro schemas can be found.
- AVRO_URL - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The URL (path) where the target database (i.e.
- AvroBoolean - Class in bdglue2.encoder.avro.column
-
Methods supporting Boolean data.
- AvroColumn - Class in bdglue2.encoder.avro.column
-
This abstract class stores meta data about the columns that we are
processing / encoding for transport.
- AvroColumn(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroColumn
-
- AvroColumnType - Enum in bdglue2.encoder.avro.column
-
These are the types of columns that we are currently supporting.
- AvroDateTime - Class in bdglue2.encoder.avro.column
-
Methods supporting Date and Time columns.
- AvroDateTime(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroDateTime
-
- AvroDouble - Class in bdglue2.encoder.avro.column
-
Methods supporting Double length floating point data.
- AvroDouble(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroDouble
-
- AvroEncoder - Class in bdglue2.encoder
-
Encodes the data as an Avro record before sending it downstream
for publishing.
- AvroEncoder() - Constructor for class bdglue2.encoder.AvroEncoder
-
- AvroFloat - Class in bdglue2.encoder.avro.column
-
Methods supporting Floating point data.
- AvroFloat(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroFloat
-
- AvroGenericRecordEncoder - Class in bdglue2.encoder
-
- AvroGenericRecordEncoder() - Constructor for class bdglue2.encoder.AvroGenericRecordEncoder
-
- AvroInteger - Class in bdglue2.encoder.avro.column
-
Methods supporing Integer columns.
- AvroInteger(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroInteger
-
- AvroLOB - Class in bdglue2.encoder.avro.column
-
Methods supporting data that should be treated as LOBs.
- AvroLOB(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroLOB
-
- AvroLong - Class in bdglue2.encoder.avro.column
-
Methods supporting Long integer data.
- AvroLong(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroLong
-
- AvroMultiByte - Class in bdglue2.encoder.avro.column
-
Methods supporting multi-byte string data (i.e.
- AvroMultiByte(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroMultiByte
-
- AvroNumeric - Class in bdglue2.encoder.avro.column
-
Methods supporting "numeric" values whose actual type must be
determined on the fly.
- AvroNumeric(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroNumeric
-
- AvroSchema - Class in bdglue2.encoder.avro
-
This class keeps up with the avro-related meta data that
we care about for processing.
- AvroSchema(String, DownstreamTableMetaData, boolean) - Constructor for class bdglue2.encoder.avro.AvroSchema
-
Construct the internal representation of the Avro schema.
- AvroSchemaFactory - Class in bdglue2.encoder.avro
-
This is a factory object to provide an easy way to track and access
the schema meta data that we are collecting.
- avroSchemaType - Variable in class bdglue2.encoder.avro.column.AvroColumn
-
- AvroString - Class in bdglue2.encoder.avro.column
-
Methods supporting String-based column data.
- AvroString(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroString
-
- AvroUnsupported - Class in bdglue2.encoder.avro.column
-
Methods dealing with column types we don't (presently) support.
- AvroUnsupported(DownstreamColumnMetaData) - Constructor for class bdglue2.encoder.avro.column.AvroUnsupported
-
- avroURL - Static variable in class bdglue2.encoder.EventHeader
-
- baos() - Method in class bdglue2.utility.schemadef.Format
-
Get the output stream we will be writing to.
- BATCH_SIZE_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The Flume event property that sets the batch size for writes to Kafka.
- bdglue2 - package bdglue2
-
- bdglue2.common - package bdglue2.common
-
- bdglue2.encoder - package bdglue2.encoder
-
- bdglue2.encoder.avro - package bdglue2.encoder.avro
-
- bdglue2.encoder.avro.column - package bdglue2.encoder.avro.column
-
- bdglue2.meta - package bdglue2.meta
-
- bdglue2.meta.schema - package bdglue2.meta.schema
-
- bdglue2.meta.transaction - package bdglue2.meta.transaction
-
- bdglue2.publisher - package bdglue2.publisher
-
- bdglue2.publisher.asynchbase - package bdglue2.publisher.asynchbase
-
- bdglue2.publisher.bigquery - package bdglue2.publisher.bigquery
-
- bdglue2.publisher.cassandra - package bdglue2.publisher.cassandra
-
- bdglue2.publisher.console - package bdglue2.publisher.console
-
- bdglue2.publisher.flume - package bdglue2.publisher.flume
-
- bdglue2.publisher.hbase - package bdglue2.publisher.hbase
-
- bdglue2.publisher.kafka - package bdglue2.publisher.kafka
-
- bdglue2.publisher.nosql - package bdglue2.publisher.nosql
-
- bdglue2.source.gghadoop - package bdglue2.source.gghadoop
-
- bdglue2.utility - package bdglue2.utility
-
- bdglue2.utility.schemadef - package bdglue2.utility.schemadef
-
- BDGLUE_PROPERTY_PREFIX - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
- BDGlueEncoder - Interface in bdglue2.encoder
-
An interface that must be implemented by all BDGlue encoders.
- BDGluePropertyValues - Class in bdglue2
-
This class contains configuration constants used by the
Big Data Glue code, including property names and where appropriate
the default values to use in the event that a property
is not defined.
- BDGluePublisher - Interface in bdglue2.publisher
-
An interface that must be implemented by all Publishers.
- BDGlueVersion - Class in bdglue2
-
A simple class that allows us to store the current version number.
- BDGlueVersion() - Constructor for class bdglue2.BDGlueVersion
-
Track the version number.
- BigDataName - Class in bdglue2.utility.schemadef
-
Utility class responsible for converting invalid table or column names to valid ones.
- BigDataName() - Constructor for class bdglue2.utility.schemadef.BigDataName
-
Instantiate in instance of BigDataName.
- BigDataName(String, String, String) - Constructor for class bdglue2.utility.schemadef.BigDataName
-
Instantiate in instance of BigDataName, using the parameters passed
in to configure it as desired.
- BIGQUERY_BATCH_SIZE - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
The number of operations to batch together.
- BIGQUERY_BATCH_SIZE_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
- BIGQUERY_DATASET - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
The BigQuery dataset name to connect to.
- BIGQUERY_DATASET_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
- BIGQUERY_FLUSH_FREQ - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
The frequency to flush operations if the batch-size isn't reached.
- BIGQUERY_FLUSH_FREQ_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
- BIGQUERY_INSERT_ONLY - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
Boolean: True if we want to convert deletes and updates into inserts.
- BIGQUERY_INSERT_ONLY_DEFAULT - Static variable in class bdglue2.publisher.bigquery.BigQueryPublisherPropertyValues
-
- BigQueryPublisher - Class in bdglue2.publisher.bigquery
-
Publish event data to Google BigQuery..
- BigQueryPublisher() - Constructor for class bdglue2.publisher.bigquery.BigQueryPublisher
-
- BigQueryPublisherPropertyValues - Class in bdglue2.publisher.bigquery
-
This class contains configuration constants used by the
Big Data Glue BigQuery Publisher, including property names and where appropriate
the default values to use in the event that a property
is not defined.
- BigQueryTable - Class in bdglue2.publisher.bigquery
-
- BigQueryTable(Table) - Constructor for class bdglue2.publisher.bigquery.BigQueryTable
-
Construct an instance that represents this table.
- bottom(String) - Method in class bdglue2.utility.schemadef.Format
-
Format the "bottom" portion of the output file.
- bottom(String) - Method in class bdglue2.utility.schemadef.FormatAvro
-
Format the bottom portion of the Avro schema file.
- bottom(String) - Method in class bdglue2.utility.schemadef.FormatCassandra
-
- bottom(String) - Method in class bdglue2.utility.schemadef.FormatHiveAvro
-
Format the bottom of the schema.
- bottom(String) - Method in class bdglue2.utility.schemadef.FormatNoSQL
-
Format the bottom portion of the schema file.
- BROKER_LIST - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
Property that identifies the Kafka broker list to use when deliverying to
Kafka.
- BROKER_LIST_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The Flume coniguration property for specifying the broker list to the
KafkaSink.
- cancel() - Method in class bdglue2.encoder.EncoderThread
-
Call this method to terminate the thread and exit.
- cancel() - Method in class bdglue2.encoder.ParallelEncoder
-
Call this method to terminate the thread and exit.
- cancel() - Method in class bdglue2.publisher.ParallelPublisher
-
Call this method to terminate the thread and exit.
- cancel() - Method in class bdglue2.publisher.PublisherThread
-
Call this method to terminate the thread and exit.
- CASSANDRA_BATCH_SIZE - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
The number of operations to batch together.
- CASSANDRA_BATCH_SIZE_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
- CASSANDRA_CONNECT_NODE - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
The node in the Cassandra cluster to connect to.
- CASSANDRA_CONNECT_NODE_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
- CASSANDRA_FLUSH_FREQ - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
The frequency to flush operations if the batch-size isn't reached.
- CASSANDRA_FLUSH_FREQ_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
- CASSANDRA_INSERT_ONLY - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
Boolean: True if we want to convert deletes and updates into inserts.
- CASSANDRA_INSERT_ONLY_DEFAULT - Static variable in class bdglue2.publisher.cassandra.CassandraPublisherPropertyValues
-
- CassandraPublisher - Class in bdglue2.publisher.cassandra
-
Publish event data to Cassandra.
- CassandraPublisher() - Constructor for class bdglue2.publisher.cassandra.CassandraPublisher
-
- CassandraPublisherPropertyValues - Class in bdglue2.publisher.cassandra
-
This class contains configuration constants used by the
Big Data Glue BigQuery Publisher, including property names and where appropriate
the default values to use in the event that a property
is not defined.
- CassandraTable - Class in bdglue2.publisher.cassandra
-
- CassandraTable(Session, String, String) - Constructor for class bdglue2.publisher.cassandra.CassandraTable
-
Construct an instance that represents this table.
- CassandraTable(Session, String) - Constructor for class bdglue2.publisher.cassandra.CassandraTable
-
Construct an instance that represents this table.
- checkCallbacks() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
check the status of the callbacks.
- checkForNULL() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
This is a bit of a hack ...
- cleanup() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Disconnect from the client.
- cleanup() - Method in class bdglue2.publisher.asynchbase.AsyncHbasePublisher
-
Clean up and disconnect from the target.
- cleanup() - Method in interface bdglue2.publisher.BDGluePublisher
-
Close connections and clean up as needed.
- cleanup() - Method in class bdglue2.publisher.bigquery.BigQueryPublisher
-
- cleanup() - Method in class bdglue2.publisher.bigquery.BigQueryTable
-
Flush any queued events and clean up timer in
preparation for shutdown.
- cleanup() - Method in class bdglue2.publisher.cassandra.CassandraPublisher
-
- cleanup() - Method in class bdglue2.publisher.console.ConsolePublisher
-
Clean up.
- cleanup() - Method in class bdglue2.publisher.flume.FlumePublisher
-
Clean up the connection and disconnect.
- cleanup() - Method in class bdglue2.publisher.hbase.HBasePublisher
-
- cleanup() - Method in class bdglue2.publisher.kafka.KafkaHelper
-
Disconnect from the producer and clean up.
- cleanup() - Method in class bdglue2.publisher.kafka.KafkaPublisher
-
Clean up and close the connection.
- cleanup() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
-
Disconnect from the producer and clean up.
- cleanup() - Method in class bdglue2.publisher.kafka.KafkaRegistryPublisher
-
Clean up and close the connection.
- cleanup() - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
Disconnect from the KVStore.
- cleanup() - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
-
Perform any cleanup needed before exiting.
- cleanup() - Method in class bdglue2.publisher.nosql.NoSQLPublisher
-
Clean up and disconnect from Oracle NoSQL.
- cleanup() - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
-
Perform any needed cleanup before exiting.
- cleanup() - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
-
Perform all necessary clean up prior to exiting.
- clearMessageList() - Method in class bdglue2.publisher.kafka.KafkaHelper
-
clear the message list.
- COLUMN_FAMILY - Static variable in class bdglue2.encoder.EventHeader
-
- ColumnInfo - Class in bdglue2.utility.schemadef
-
Contains meta data about the column we are currently working with.
- ColumnInfo() - Constructor for class bdglue2.utility.schemadef.ColumnInfo
-
- columnType - Variable in class bdglue2.encoder.avro.column.AvroColumn
-
- columnTypeString - Variable in class bdglue2.encoder.avro.column.AvroColumn
-
- configure(PropertyManagement) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Configure the class based on the properties for the user exit.
- configure(PropertyManagement) - Method in class bdglue2.publisher.kafka.KafkaHelper
-
Configure the class based on the properties for the user exit.
- configure(PropertyManagement) - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
-
Configure the class based on the properties for the user exit.
- configure(PropertyManagement) - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
Configure the class based on the properties for the user exit.
- connect() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Connect to the client.
- connect() - Method in class bdglue2.publisher.asynchbase.AsyncHbasePublisher
-
Connect to HBase.
- connect() - Method in interface bdglue2.publisher.BDGluePublisher
-
Connect to the target.
- connect() - Method in class bdglue2.publisher.bigquery.BigQueryPublisher
-
- connect() - Method in class bdglue2.publisher.cassandra.CassandraPublisher
-
- connect() - Method in class bdglue2.publisher.console.ConsolePublisher
-
Connect.
- connect() - Method in class bdglue2.publisher.flume.FlumePublisher
-
Connect to Flume.
- connect() - Method in class bdglue2.publisher.hbase.HBasePublisher
-
- connect() - Method in class bdglue2.publisher.kafka.KafkaHelper
-
connect to the Kafka producer.
- connect() - Method in class bdglue2.publisher.kafka.KafkaPublisher
-
Connect to Kafka.
- connect() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
-
connect to the Kafka producer.
- connect() - Method in class bdglue2.publisher.kafka.KafkaRegistryPublisher
-
Connect to Kafka.
- connect() - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
Connect to the NoSQL KVStore.
- connect() - Method in class bdglue2.publisher.nosql.NoSQLPublisher
-
Connect to Oracle NoSQL.
- ConsolePublisher - Class in bdglue2.publisher.console
-
A simple publisher that writes all data to the console (i.e.
- ConsolePublisher() - Constructor for class bdglue2.publisher.console.ConsolePublisher
-
- containsTable(String) - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
-
Determine if we have already added this table to the meta data
we are managing.
- createRowToInsert(DownstreamOperation) - Method in class bdglue2.publisher.bigquery.BigQueryTable
-
Create a row for this operation and return it.
- DEFAULT_BATCH_SIZE - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The default batch size.
- DEFAULT_BATCHSIZE - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
-
The default batchSize to use.
- DEFAULT_FLUSH_FREQ - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
Force flush of accumulated records after ths number of
milliseconds in low volume situations where batch size has
note yet been met.
- DEFAULT_KEY_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The default serializer for the Kafka partitioning key.
- DEFAULT_MESSAGE_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The default message serializer to use when writing the event body.
- DEFAULT_REQUIRED_ACKS - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The default value for requiring acks from Kafka after write.
- DEFAULT_TIMEOUT - Static variable in class bdglue2.publisher.asynchbase.AsyncHbasePublisherPropertyValues
-
The default timeout to use.
- DEFAULT_TOPIC - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The default topic to publish to in the event that one is not specified.
- defaultProperties - Static variable in class bdglue2.BDGluePropertyValues
-
The name of the default properties "resource" to look for.
- defaultProperties - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
- DELETE_ID - Static variable in class bdglue2.meta.transaction.DownstreamOperation
-
- DELETE_VALUE - Static variable in class bdglue2.meta.transaction.DownstreamOperation
-
- DelimitedTextEncoder - Class in bdglue2.encoder
-
Encodes the operation as delimited text.
- DelimitedTextEncoder() - Constructor for class bdglue2.encoder.DelimitedTextEncoder
-
- destroy() - Method in class bdglue2.source.gghadoop.GG12Handler
-
Clean up on exit as the handler is being destroyed.
- DownstreamColumnData - Class in bdglue2.meta.transaction
-
Class that contains the data captured for a column.
- DownstreamColumnData(String, String, byte[], boolean) - Constructor for class bdglue2.meta.transaction.DownstreamColumnData
-
Construct an object that contains the data associated with a particular
column that we will be processing.
- DownstreamColumnMetaData - Class in bdglue2.meta.schema
-
Column meta data containing only the info we need downstream for
processing.
- DownstreamColumnMetaData(String, boolean, boolean, int) - Constructor for class bdglue2.meta.schema.DownstreamColumnMetaData
-
Build an instance of this class from the supplied column meta data.
- DownstreamOperation - Class in bdglue2.meta.transaction
-
The data that represents the operation type for this record.
- DownstreamOperation(String, String, String, String, String, DownstreamTableMetaData) - Constructor for class bdglue2.meta.transaction.DownstreamOperation
-
Create an operation to pass along for processing from the supplied meta data.
- DownstreamSchemaMetaData - Class in bdglue2.meta.schema
-
A container class holding the meta data for all of the tables that
have been mapped.
- DownstreamSchemaMetaData() - Constructor for class bdglue2.meta.schema.DownstreamSchemaMetaData
-
- DownstreamTableMetaData - Class in bdglue2.meta.schema
-
A reduced subset of TableMetaData information that only contains the data
that we care about downstream.
- DownstreamTableMetaData(String, String, String) - Constructor for class bdglue2.meta.schema.DownstreamTableMetaData
-
Create a table from the given meta data.
- drainTo(Collection<T>) - Method in class bdglue2.encoder.EventQueue
-
Drain the queue to the specified collection.
- encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.AvroEncoder
-
Loop through operation to put data into a record.
- encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.AvroGenericRecordEncoder
-
Loop through operation to put data into a record.
- encodeDatabaseOperation(DownstreamOperation) - Method in interface bdglue2.encoder.BDGlueEncoder
-
- encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.DelimitedTextEncoder
-
Put the columns into delimited text format for output.
- encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.JsonEncoder
-
Encode the DownstreamOperation as a JSON record.
- encodeDatabaseOperation(DownstreamOperation) - Method in class bdglue2.encoder.NullEncoder
-
Perform no encoding of the DownstreamOperation.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroBoolean
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroColumn
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroDateTime
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroDouble
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroFloat
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroInteger
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroLOB
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroLong
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroMultiByte
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroNumeric
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroString
-
Encode the data for this column.
- encodeForAvro(DownstreamColumnData) - Method in class bdglue2.encoder.avro.column.AvroUnsupported
-
Encode the data for this column.
- ENCODER_CLASS - Static variable in class bdglue2.BDGluePropertyValues
-
The class name of encoder we will utilize: AvroEncoder, JsonEncoder, etc.
- ENCODER_DELIMITER - Static variable in class bdglue2.BDGluePropertyValues
-
The delimiter to use in Delimited Text encoding.
- ENCODER_DELIMITER_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
-
the default delimiter to use if one is not specified.
- ENCODER_THREADS - Static variable in class bdglue2.BDGluePropertyValues
-
The number of threads to have executing the encoding process.
- ENCODER_THREADS_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
-
The default number of encoder threads.
- EncoderFactory - Class in bdglue2.encoder
-
A factory class that instantiates encoders of the type
specified in the properties file on request.
- EncoderFactory() - Constructor for class bdglue2.encoder.EncoderFactory
-
- encoderFactory() - Static method in class bdglue2.encoder.EncoderFactory
-
Creates an instance of the class specified in the properties file.
- encoderInputQueueSize - Static variable in class bdglue2.encoder.EventQueue
-
- encoderOutputQueueSize - Static variable in class bdglue2.encoder.EventQueue
-
- EncoderThread - Class in bdglue2.encoder
-
A class that manages the individual encoders that get instantiated for the
encoder pool.
- EncoderThread() - Constructor for class bdglue2.encoder.EncoderThread
-
- EncoderThread(String) - Constructor for class bdglue2.encoder.EncoderThread
-
Create an instance with this thread name.
- encoderType - Variable in class bdglue2.encoder.AvroEncoder
-
- EncoderType - Enum in bdglue2.encoder
-
An enumeration that lists the encoder types that are inerently part of BDGlue,
and provides an option to identify a custom encoder.
- escapeChars(String) - Static method in class bdglue2.encoder.TextEncoderHelper
-
Escape any characters in the string that need escaping.
- eventBody(Object) - Method in class bdglue2.encoder.EventData
-
Set the event body for this event.
- eventBody() - Method in class bdglue2.encoder.EventData
-
Return the body of the event as the Object that was passed into the
constructor.
- EventData - Class in bdglue2.encoder
-
This class represents the output of the encoding process.
- EventData() - Constructor for class bdglue2.encoder.EventData
-
- EventData(EncoderType, Map<String, String>, Object) - Constructor for class bdglue2.encoder.EventData
-
Construct an event based on the provided meta data and body.
- eventHeader - Variable in class bdglue2.encoder.AvroEncoder
-
- EventHeader - Class in bdglue2.encoder
-
A class for manageing the event header / meta information.
- EventHeader() - Constructor for class bdglue2.encoder.EventHeader
-
- EventQueue<T> - Class in bdglue2.encoder
-
A class that manages a queue of events for processing.
- EventQueue(String, int) - Constructor for class bdglue2.encoder.EventQueue
-
Create a queue for managing EventData.
- externalProperties - Static variable in class bdglue2.BDGluePropertyValues
-
The external properties file to look for.
- externalProperties - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
- FLUME_HOST - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The name of the target host that we will connect to.
- FLUME_HOST_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The default target host name.
- FLUME_PORT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The port number on the target host that we will connect to.
- FLUME_PORT_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The default target port number.
- FLUME_PROPERTY_PREFIX - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
- FLUME_RPC_RETRIES - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
number of times to try to reconnect on RPC connection failure.
- FLUME_RPC_RETRY_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
the default number of times to retry a lost connection.
- FLUME_RPC_RETRY_DELAY - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The number of seconds to pause between each RPC connection retry.
- FLUME_RPC_RETRY_DELAY_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The default amount of time to pause before retrying a failed attempt to connect.
- FLUME_RPC_TYPE - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The type or RPC connection: avro-rpc, thrift-rpc.
- FLUME_RPC_TYPE_DEFAULT - Static variable in class bdglue2.publisher.flume.FlumePublisherPropertyValues
-
The default RPC_TYPE.
- FlumePublisher - Class in bdglue2.publisher.flume
-
An implementation of Publisher to communicate to Flume.
- FlumePublisher() - Constructor for class bdglue2.publisher.flume.FlumePublisher
-
- FlumePublisherPropertyValues - Class in bdglue2.publisher.flume
-
This class contains configuration constants used by the
Big Data Glue Flume Publisher, including property names and where appropriate
the default values to use in the event that a property
is not defined.
- forceShutdown(String) - Static method in class bdglue2.encoder.ParallelEncoder
-
Static function that decouples downstream callers from the upstream handler.
- format() - Method in class bdglue2.BDGlueVersion
-
Format the version information.
- Format - Class in bdglue2.utility.schemadef
-
Base class for the schema formaters that we support.
- Format() - Constructor for class bdglue2.utility.schemadef.Format
-
- FormatAvro - Class in bdglue2.utility.schemadef
-
Format the column meta data as an Avro schema.
- FormatAvro() - Constructor for class bdglue2.utility.schemadef.FormatAvro
-
- FormatCassandra - Class in bdglue2.utility.schemadef
-
Format the Cassandra schema meta data.
- FormatCassandra() - Constructor for class bdglue2.utility.schemadef.FormatCassandra
-
- FormatHiveAvro - Class in bdglue2.utility.schemadef
-
Format the Hive schema meta data based on the assumption that we will be
storing data in HDFS as Avro files.
- FormatHiveAvro() - Constructor for class bdglue2.utility.schemadef.FormatHiveAvro
-
- FormatNoSQL - Class in bdglue2.utility.schemadef
-
Format the metadata for this table as "ddl" for the Oracle
NoSQL database's "table" API.
- FormatNoSQL() - Constructor for class bdglue2.utility.schemadef.FormatNoSQL
-
- GENERATE_AVRO_SCHEMA - Static variable in class bdglue2.BDGluePropertyValues
-
boolean on whether or not to generate the avro schema on the fly.
- generateFieldDoc(boolean, String) - Method in class bdglue2.encoder.avro.AvroSchema
-
Generate the String used to populate the "doc" property for a column.
- getAPIType() - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
- getAvroColumn(String) - Method in class bdglue2.encoder.avro.AvroSchema
-
Return the meta data we are tracking for this column.
- getAvroSchema() - Method in class bdglue2.encoder.avro.AvroSchema
-
Get the avro schema.
- getAvroSchema(String) - Method in class bdglue2.encoder.avro.AvroSchemaFactory
-
Locate the AvroSchema object associated with the table we are processing.
- getAvroSchemaFactory() - Static method in class bdglue2.encoder.avro.AvroSchemaFactory
-
Singleton Getter of the factory object.
- getBatchSize() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
- getBDColumnName() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
-
Get the column name in an appropriate format for
big data targets, which don't support special characters.
- getBDLongTableName() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
-
Get the "long" (schema.table) version of the table name, which
in some cases could very well be the same as the short name.
- getBDName() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Get the name of this column in a "Big Data Friendly" format.
- getBDTableName() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
-
Get the "short" name of this table.
- getBefores() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the before image column information associated with this operation and return
it as an ArrayList.
- getBoundStatement(DownstreamOperation, boolean) - Method in class bdglue2.publisher.cassandra.CassandraTable
-
Create a bound statement for this operation and return it.
- getBuffer() - Method in class bdglue2.utility.schemadef.Format
-
Get the output stream as a String.
- getColumn(String) - Method in class bdglue2.meta.schema.DownstreamTableMetaData
-
Find the meta data for the requested column.
- getColumns() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
-
Get the columns for this table as an array.
- getColumns() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the column information associated with this operation and return
it as an ArrayList.
- getColumnType() - Method in class bdglue2.encoder.avro.column.AvroColumn
-
- getColumnTypeString() - Method in class bdglue2.encoder.avro.column.AvroColumn
-
- getDBConnection() - Method in class bdglue2.utility.schemadef.SchemaDef
-
Get a JDBC connection to the database.
- getDefaultValue() - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Get the default value for this column.
- getEncoderType() - Method in class bdglue2.encoder.AvroEncoder
-
Return the EncoderType.
- getEncoderType() - Method in interface bdglue2.encoder.BDGlueEncoder
-
- getEncoderType() - Method in class bdglue2.encoder.DelimitedTextEncoder
-
Returns the EncoderType.
- getEncoderType() - Static method in class bdglue2.encoder.EncoderFactory
-
Return the EncoderType for specified encoder.
- getEncoderType() - Method in class bdglue2.encoder.EventData
-
Get the encoder type we used to create this event.
- getEncoderType() - Method in class bdglue2.encoder.JsonEncoder
-
Get the EncoderType.
- getEncoderType() - Method in class bdglue2.encoder.NullEncoder
-
- getEventHeader() - Method in class bdglue2.encoder.EventHeader
-
- getFieldSchema() - Method in class bdglue2.encoder.avro.column.AvroColumn
-
Set all columns marked as nullable this way, including key columns.
- getHeaders() - Method in class bdglue2.encoder.EventData
-
Get the header information for this operation.
- getIncrements() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
- getJdbcType() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
-
Get the type associated with this column.
- getJdbcType() - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Get the jdbc type for this column as an integer.
- getKafkaBatchSize() - Static method in class bdglue2.publisher.kafka.KafkaProperties
-
Get the batch size from the properties.
- getKafkaBDGlueProperties() - Static method in class bdglue2.publisher.kafka.KafkaProperties
-
Get the Kafka properties as configured by BDGlue.
- getKafkaFlushFreq() - Static method in class bdglue2.publisher.kafka.KafkaProperties
-
Get the flush frequency from the properties.
- getKafkaTopic() - Static method in class bdglue2.publisher.kafka.KafkaProperties
-
Get the name of the Kafka topic from the properties.
- getKey(String) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
-
Convert the String representation of the key into a
proper instance of a NoSQL Key.
- getKeyName() - Method in class bdglue2.meta.schema.DownstreamTableMetaData
-
Get the "key" value for this table that is used to locate it
in the Set of tables we are managing.
- getKeyName() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the table name to which this operation pertains and which is used as
a key to locate the meta data.
- getKeyNames() - Method in class bdglue2.common.PropertyManagement
-
Get a list of all of the property names.
- getKVStore() - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
- getLongTableName() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the long table name to which this operation pertains.
- getMessageKey(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
-
- getMessageKey(EventData) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
-
Get the message key for this message and return it to the KafkaPublisher.
- getMessageKey(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
-
- getMessageKey(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
-
- getMetadataCols() - Method in class bdglue2.encoder.MetadataHelper
-
Return a Set that contains the names of the metadata columns
that have been configured in the properties file.
- getMetadataCols() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the metadata column names as configured in the properties file.
- getMetadataHelper() - Static method in class bdglue2.encoder.MetadataHelper
-
Get the metadata helper.
- getMetaValue(String) - Method in class bdglue2.encoder.EventData
-
Return the value of the specified key from the operation's
meta information.
- getName() - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Get the column name.
- getOpMetadata(DownstreamOperation) - Method in class bdglue2.encoder.MetadataHelper
-
Create a Map containing the metadata columns
that we want to include with this operation.
- getOpMetadata() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the metadata column data for this operation as configured in the properties file.
- getOpType() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the operation type that was passed into the constructor.
- getOpTypeId() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the operation type as an integer that may be more efficient
in case statements downstream.
- getOrigColumnName() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
-
Get the original column name.
- getOrigName() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Get the original column name.
- getPosition() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the relative position of this operation from the source.
- getProducer() - Method in class bdglue2.publisher.kafka.KafkaHelper
-
- getProducer() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
-
- getProperties(String, String) - Static method in class bdglue2.common.PropertyManagement
-
Typically, we want a singleton in our application that
will hold all of our properties.
- getProperties() - Static method in class bdglue2.common.PropertyManagement
-
Return the singleton instance.
- getProperties() - Method in class bdglue2.utility.schemadef.Format
-
Get the properties for the utility.
- getProperty(String) - Method in class bdglue2.common.PropertyManagement
-
Get the value of the specified property.
- getProperty(String, String) - Method in class bdglue2.common.PropertyManagement
-
Get the value of the specified property, setting a default value
if the property has not been intitialized.
- getPropertySubset(String, boolean) - Method in class bdglue2.common.PropertyManagement
-
Return a subset of the properties that begin with "prefix".
- getRowKey() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Create a contcatenation of the key columns into a
single String, separating each value from the one preceding
it with a '/'.
- getRPCType() - Method in class bdglue2.publisher.flume.FlumePublisher
-
Get the type of RPC connection we are supposed to make.
- getSchemaFileName() - Method in class bdglue2.encoder.avro.AvroSchema
-
Get the name of the avro schema file we want to read or write.
- getSchemaFilePath() - Method in class bdglue2.encoder.avro.AvroSchema
-
Generate path + fileName for reading or writing an avro schema.
- getSchemaId() - Method in class bdglue2.encoder.avro.AvroSchema
-
- getTable(String) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
-
Get the KV Table object for this event.
- getTableMeta() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the table meta data that corresponds to this operation.
- getTableMetadata() - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
-
Get the meta data for this table as a Set.
- getTableMetaData(String) - Method in class bdglue2.meta.schema.DownstreamSchemaMetaData
-
Get the meta data for an individual table.
- getTableName() - Method in class bdglue2.encoder.avro.AvroSchema
-
Get the name of this table.
- getTableName() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the short table name to which this operation pertains.
- getTimeStamp() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the transaction timestamp that was passed into the constructor.
- getTopic(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
-
- getTopic(EventData) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
-
Get the token for this message and return it to the KafkaPublisher.
- getTopic(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
-
- getTopic(EventData) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
-
- getTxId() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get the transaction ID that was passed into the constructor.
- getType() - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Get the type of column (string, integer, float, etc.).
- getUserTokens() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Get any runtime supplied meta data.
- getValue(String, byte[]) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
-
Store the body of the event as the value of the key.
- GG12Handler - Class in bdglue2.source.gghadoop
-
Subclass of AbstractHandler class as defined by the GoldenGate
Java User Exit documentation.
- GG12Handler(TxOpMode) - Constructor for class bdglue2.source.gghadoop.GG12Handler
-
Construct a handler using the specified operation mode.
- GG12Handler() - Constructor for class bdglue2.source.gghadoop.GG12Handler
-
Construct the handler defaulting to operation (op) mode;
Setters should be called if needed to set additional properties
on the handler.
- GG12HandlerMapper - Class in bdglue2.source.gghadoop
-
This class essentially takes care of mapping the classes that
are defined and used by the GoldenGate Java Adapter to the classes
that are used by BDGlue.
- GG12HandlerMapper() - Constructor for class bdglue2.source.gghadoop.GG12HandlerMapper
-
- IGNORE_UNCHANGED - Static variable in class bdglue2.BDGluePropertyValues
-
Boolean: true = ignore operations where data is unchagned.
- IGNORE_UNCHANGED_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
-
The default value for IGNORE_UNCHANGED.
- INCLUDE_BEFORES - Static variable in class bdglue2.BDGluePropertyValues
-
Send before images of data along.
- INCLUDE_BEFORES_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
-
The default value for INCLUDE_BEFORES.
- init() - Method in class bdglue2.encoder.ParallelEncoder
-
Initializes the ecoder with the specified number
of Threads, etc.
- init() - Method in class bdglue2.publisher.PublisherThread
-
(Re)initialize this thread and create the Publisher.
- init(DsConfiguration, DsMetaData) - Method in class bdglue2.source.gghadoop.GG12Handler
-
Initialize the base class and then do any other additional
initialization specific to this user exit.
- init() - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
-
Create the appropriate encoder and initialize.
- init() - Method in class bdglue2.utility.schemadef.FormatAvro
-
Reinitialize so we can use this again.
- init() - Method in class bdglue2.utility.schemadef.FormatCassandra
-
Reset so we can use this again.
- init() - Method in class bdglue2.utility.schemadef.FormatHiveAvro
-
Reset so we can use this again.
- init() - Method in class bdglue2.utility.schemadef.FormatNoSQL
-
Reset things so we can reuse this instance.
- initialize() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Perform any needed initialization.
- initialize() - Method in class bdglue2.publisher.kafka.KafkaHelper
-
Perform any needed initialization.
- initialize() - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
-
Perform any needed initialization.
- initialize() - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
Perform any needed initialization of the serializer.
- initialize() - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
-
Perform any needed initialization of this event serializer.
- initialize() - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
-
Perform any needed initialization.
- initializeCallbacks() - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Initialize the callbacks for this transaction.
- INSERT_ID - Static variable in class bdglue2.meta.transaction.DownstreamOperation
-
- INSERT_VALUE - Static variable in class bdglue2.meta.transaction.DownstreamOperation
-
- INVALID_ID - Static variable in class bdglue2.meta.transaction.DownstreamOperation
-
- isDataChanged() - Method in class bdglue2.meta.transaction.DownstreamOperation
-
Compares the before and after images of update operations and
returns true if all of the column values in the after image
(which may not be a complete column list) DO NOT match the
corresponding values in the before image.
- isKeyCol() - Method in class bdglue2.encoder.avro.column.AvroColumn
-
- isKeyCol() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
-
Is this a key column?
- isKeyCol() - Method in class bdglue2.meta.transaction.DownstreamColumnData
-
Is this a key column?
- isKeyCol() - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Indicate whether or not this is a key column.
- isNullable() - Method in class bdglue2.encoder.avro.column.AvroColumn
-
- isNullable() - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
-
Can this column be null?
- isNullable() - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Indicate if this column can be null.
- KAFKA_BATCH_SIZE - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
The batchize used for writes to Kafka.
- KAFKA_BROKER_LIST - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
A comma separated list of Kakfa brokers.
- KAFKA_FLUSH_FREQ - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
The frequency to flush data if the batch size specified hasn't been reached.
- KAFKA_KEY_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
Used to override the default serializer for Kafka event keys.
- KAFKA_MESSAGE_METADATA - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
A class that implements KafkaMessageHelper to return token/message key info.
- KAFKA_MESSAGE_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
Used to override the default serializer for Kafka event payloads.
- KAFKA_REGISTRY_ID_SIZE - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
The lenght of the id field to add to a serialized message.
- KAFKA_REGISTRY_MAGIC_BYTE - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
The magic byte to add to a serialized message.
- KAFKA_REGISTRY_MAX_SCHEMAS - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
The maximum schemas per subject to store.
- KAFKA_REGISTRY_URL - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
URL where we can find the registry.
- KAFKA_REQUIRED_ACKS - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
Tell the producer to require an acknowledgement from the Broker that
a message was received.
- KAFKA_TOPIC - Static variable in class bdglue2.publisher.kafka.KafkaPublisherPropertyValues
-
A default Kafka topic.
- KafkaHelper - Class in bdglue2.publisher.kafka
-
A helper class that contains common functionality leveraged by both the
Flume KafkaSink and by the KafkaPulisher.
- KafkaHelper() - Constructor for class bdglue2.publisher.kafka.KafkaHelper
-
- KafkaMessageDefaultMeta - Class in bdglue2.publisher.kafka
-
Default class for getting metadata for the Kafka message.
- KafkaMessageDefaultMeta() - Constructor for class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
-
- KafkaMessageHelper - Interface in bdglue2.publisher.kafka
-
A simple interface used for defining helper classes that allow for
custom logic for defining Kafka message Topics and Keys.
- KafkaMessageTableKey - Class in bdglue2.publisher.kafka
-
Return the table name as the topic, and a representation of the
primary key as the Kafka message key.
- KafkaMessageTableKey() - Constructor for class bdglue2.publisher.kafka.KafkaMessageTableKey
-
- KafkaMessageTableKeyBb - Class in bdglue2.publisher.kafka
-
Return the short table name as the topic, and a representation of the
primary key as the Kafka message key, prefixed by the schema name.
- KafkaMessageTableKeyBb() - Constructor for class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
-
- KafkaProperties - Class in bdglue2.publisher.kafka
-
Inspired by org.apache.flume.sink.kafka.KafkaSinkConstants.
- KafkaProperties() - Constructor for class bdglue2.publisher.kafka.KafkaProperties
-
- KafkaPublisher - Class in bdglue2.publisher.kafka
-
Publish event data to Kafka.
- KafkaPublisher() - Constructor for class bdglue2.publisher.kafka.KafkaPublisher
-
- KafkaPublisherPropertyValues - Class in bdglue2.publisher.kafka
-
This class contains configuration constants used by the
Big Data Glue Kafka Publisher, including property names and where appropriate
the default values to use in the event that a property
is not defined.
- KafkaRegistry - Class in bdglue2.publisher.kafka
-
- KafkaRegistry() - Constructor for class bdglue2.publisher.kafka.KafkaRegistry
-
- KafkaRegistryHelper - Class in bdglue2.publisher.kafka
-
A helper class that contains functionality needed by the
KafkaRegistryPulisher.
- KafkaRegistryHelper() - Constructor for class bdglue2.publisher.kafka.KafkaRegistryHelper
-
- KafkaRegistryPublisher - Class in bdglue2.publisher.kafka
-
- KafkaRegistryPublisher() - Constructor for class bdglue2.publisher.kafka.KafkaRegistryPublisher
-
- KEY_SERIALIZER - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
Property that identifies the serializer to use for writing the
Kafka partitioning key value.
- newAvroColumn(DownstreamColumnMetaData) - Static method in class bdglue2.encoder.avro.column.AvroColumn
-
Static factory class.
- NEWLINE_CHAR - Static variable in class bdglue2.BDGluePropertyValues
-
Replace newline characters in string fields with this character.
- NOSQL_API - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
Specify whether to use the KV or Table API when writing to NoSQL.
- NOSQL_API_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The default NoSQL API to use if one isn't specified.
- NOSQL_DURABILITY - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The durability model for NoSQL transactions.
- NOSQL_DURABILITY_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The default NoSQL durability model.
- NOSQL_HOST - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The name of the NoSQL host.
- NOSQL_HOST_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The default host to connect to if one isn't specified.
- NOSQL_KVSTORE - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The name of the NoSQL KVStore.
- NOSQL_KVSTORE_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The default NoSQL datastore name.
- NOSQL_PORT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The port where NoSQL is listening.
- NOSQL_PORT_DEFAULT - Static variable in class bdglue2.publisher.nosql.NoSQLPublisherPropertyValues
-
The default NoSQL port.
- NoSQLHelper - Class in bdglue2.publisher.nosql
-
An abstract class for common code between the NoSQL KV and Table helper classes.
- NoSQLHelper() - Constructor for class bdglue2.publisher.nosql.NoSQLHelper
-
- NoSQLHelper.API_TYPE - Enum in bdglue2.publisher.nosql
-
- NoSQLKVHelper - Class in bdglue2.publisher.nosql
-
A helper class that contains shared functionality for the NoSQL
KV API for Flulme and direct connections.
- NoSQLKVHelper() - Constructor for class bdglue2.publisher.nosql.NoSQLKVHelper
-
- NoSQLPublisher - Class in bdglue2.publisher.nosql
-
Publish data to the Oracle NoSQL database.
- NoSQLPublisher() - Constructor for class bdglue2.publisher.nosql.NoSQLPublisher
-
Create an instance of the Oracl NoSQL publisher for the specified
NoSQL API: TABLE or KV.
- NoSQLPublisherPropertyValues - Class in bdglue2.publisher.nosql
-
This class contains configuration constants used by the
Big Data Glue NoSQL Publisher, including property names and where appropriate
the default values to use in the event that a property
is not defined.
- NoSQLTableHelper - Class in bdglue2.publisher.nosql
-
A helper class containing common functionality for the Table API.
- NoSQLTableHelper() - Constructor for class bdglue2.publisher.nosql.NoSQLTableHelper
-
- NullEncoder - Class in bdglue2.encoder
-
This class does no encoding of the database operation.
- NullEncoder() - Constructor for class bdglue2.encoder.NullEncoder
-
- NUMERIC_ENCODING - Static variable in class bdglue2.BDGluePropertyValues
-
Set the type we should encode numeric/decimal types to.
- NUMERIC_ENCODING - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Set the type we should encode numeric/decimal types to.
- NUMERIC_ENCODING_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
-
- numericEncoding() - Method in class bdglue2.utility.schemadef.SchemaDef
-
Determine how to encode fixed decimal types.
- ParallelEncoder - Class in bdglue2.encoder
-
A class that manages the encoder thread pool, and itself runs as a thread.
- ParallelEncoder() - Constructor for class bdglue2.encoder.ParallelEncoder
-
construct an encoder with the number of
threads specified in the properties for processing.
- ParallelEncoder(int) - Constructor for class bdglue2.encoder.ParallelEncoder
-
Construct an encoder with the specified number
of threads for processing.
- ParallelPublisher - Class in bdglue2.publisher
-
A class that manages a pool of publisher threads and itself executes as a thread.
- ParallelPublisher() - Constructor for class bdglue2.publisher.ParallelPublisher
-
construct a Publisher with the defualt number of
threads for processing.
- ParallelPublisher(int) - Constructor for class bdglue2.publisher.ParallelPublisher
-
Construct a Publisher with the specified number
of threads for processing.
- peek() - Method in class bdglue2.encoder.EncoderThread
-
Take a look at what is next in the queue without removing it, if anything.
- peek() - Method in class bdglue2.encoder.EventQueue
-
Peek at the object at the head of the queue.
- populateAvroRecord(AvroSchema, DownstreamOperation, Schema) - Method in class bdglue2.encoder.AvroEncoder
-
Populate the fields in the Avro record.
- POSITION - Static variable in class bdglue2.encoder.EventHeader
-
- POSITION_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The name for the generated position column.
- printProperties() - Method in class bdglue2.common.PropertyManagement
-
Print the properties for this instance of PropertyManagement.
- printProperties(Properties) - Method in class bdglue2.common.PropertyManagement
-
Print the properties found in the specified
instance of Properties in sorted order.
- process(EventData) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Process the received BDGlue event.
- process(EventData) - Method in class bdglue2.publisher.kafka.KafkaHelper
-
Process the received BDGlue event.
- process(EventData) - Method in class bdglue2.publisher.kafka.KafkaRegistryHelper
-
Process the received BDGlue event and send to Kafka.
- process(EventData) - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
Process the received BDGlue event.
- process(EventData) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
-
Process the BDGlue event.
- process(EventData) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
-
Process the BDGlue event.
- processAvro(Map<String, String>, byte[]) - Method in class bdglue2.publisher.nosql.NoSQLKVHelper
-
Write the event data to NoSQL using the KV API.
- processJSON(String, byte[]) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
-
Parse JSON-encoded event body and write the row to NoSQL.
- processOperation(DownstreamOperation) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Iterate through the operation and write to NoSQL.
- processOperation(String, DownstreamOperation) - Method in class bdglue2.publisher.nosql.NoSQLTableHelper
-
Iterate through the operation and write to NoSQL.
- processOperation(Op) - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
-
Process the database operation and put it into a form
that BDGlue can understand.
- PropertyManagement - Class in bdglue2.common
-
Manage properties for the application.
- PropertyManagement(String, String) - Constructor for class bdglue2.common.PropertyManagement
-
Load the properties from the properties file.
- publish(EventData) - Method in class bdglue2.publisher.ParallelPublisher
-
Route the event to the appropriate PublisherThread for processing.
- PUBLISHER_CLASS - Static variable in class bdglue2.BDGluePropertyValues
-
the name of the implementation of Publisher that should be called.
- PUBLISHER_HASH - Static variable in class bdglue2.BDGluePropertyValues
-
Select publisher thread based on hash of table name or rowkey.
- PUBLISHER_THREADS - Static variable in class bdglue2.BDGluePropertyValues
-
The number of threads to have executing the publishing process.
- PUBLISHER_THREADS_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
-
The default number of publisher threads.
- PublisherFactory - Class in bdglue2.publisher
-
A factory class that creates an instance of the appropriate publisher.
- publisherFactory() - Static method in class bdglue2.publisher.PublisherFactory
-
Return an instance of Publisher that
corresponds to the specified TargetType.
- publisherQueueSize - Static variable in class bdglue2.encoder.EventQueue
-
- PublisherThread - Class in bdglue2.publisher
-
A class that manages an instance of a Publisher in its own thread.
- PublisherThread() - Constructor for class bdglue2.publisher.PublisherThread
-
Create an instance with the default thread name of "myThread".
- PublisherThread(String) - Constructor for class bdglue2.publisher.PublisherThread
-
Create an instance with this thread name.
- publisherThreadQueueSize - Static variable in class bdglue2.encoder.EventQueue
-
- PublisherType - Enum in bdglue2.publisher
-
Enumeration that indicates the type of publisher.
- publishEvents() - Method in class bdglue2.publisher.hbase.HBasePublisher
-
publish all events that we have queued up to Kafka.
- publishEvents() - Method in class bdglue2.publisher.kafka.KafkaPublisher
-
publish all events that we have queued up to Kafka.
- put(DownstreamOperation) - Method in class bdglue2.encoder.EncoderThread
-
Put an input operation on the inputQueue.
- put(T) - Method in class bdglue2.encoder.EventQueue
-
Put an event on this queue.
- put(DownstreamOperation) - Method in class bdglue2.encoder.ParallelEncoder
-
Puts the operation on the input queue for subsequent processing.
- put(EventData) - Method in class bdglue2.publisher.ParallelPublisher
-
Puts the event the appropriate queue for
subsequent processing.
- put(EventData) - Method in class bdglue2.publisher.PublisherThread
-
Put an event on the inputQueue.
- putColumnFamily(String) - Method in class bdglue2.encoder.EventHeader
-
Set the column family in the event header.
- putHeaderData(String, String) - Method in class bdglue2.encoder.EventHeader
-
This is header data that will travel along with the encoded record
for downstream processing.
- putOpType(String) - Method in class bdglue2.encoder.EventHeader
-
Set the operation type in the event header.
- putRowKey(String) - Method in class bdglue2.encoder.EventHeader
-
Put the key value for the row in the Avro event header.
- putSchemaURL(String) - Method in class bdglue2.encoder.EventHeader
-
Put the URL to the Avro schema file in HDFS in the
Avro event header.
- putShortName(String) - Method in class bdglue2.encoder.EventHeader
-
Set the simple table name (i.e.
- putTable(String) - Method in class bdglue2.encoder.EventHeader
-
Set the table name in the Avro event header.
- putTimeStamp(String) - Method in class bdglue2.encoder.EventHeader
-
Put the transaction timestamp in the Avro event header.
- readSchemaFile(String) - Method in class bdglue2.encoder.avro.AvroSchema
-
Read the JSON formated schema from an avro schema file.
- registerSchema(String, Schema) - Method in class bdglue2.publisher.kafka.KafkaRegistry
-
Register the schema with the kafka schema registry.
- REPLACE_CHAR - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Replace special characters that are valid in RDBMS table/column
names, but are not valid in hive/hbase/nosql/etc.
- REPLACE_CHAR_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The default character to use when replacing invalid characters that are
not at the beginning of a field name.
- REPLACE_FIRST - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Replace special characters at the beginning of a field name
that are valid in RDBMS table/column
names, but are not valid in hive/hbase/nosql/etc.
- REPLACE_FIRST_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The default character to use when replacing an invalid first character of an
field name.
- REPLACE_NEWLINE - Static variable in class bdglue2.BDGluePropertyValues
-
Replace newline characters in string fields with some other character.
- REPLACE_NEWLINE_DEFAULT - Static variable in class bdglue2.BDGluePropertyValues
-
The default value for REPLACE_NEWLINE.
- REPLACE_REGEX - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Specifies the regular expression to use to identify invalid characters
in a field name.
- REPLACE_REGEX_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The default regular expression.
- REPLICATION_STRATEGY - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The replication strategy for Cassandra.
- REPLICATION_STRATEGY_DEFAULT - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
- reportStatus() - Method in class bdglue2.source.gghadoop.GG12Handler
-
Get the status of this handler.
- reportStatus() - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
-
Report the status of this handler, including all encoder and
publisher threads running in BDGlue.
- REQUIRED_ACKS - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
Property that identifies how to require acks from Kafka.
- REQUIRED_ACKS_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The Flume coniguration property for specifying the required acks value
to the KafkaSink.
- ROWKEY - Static variable in class bdglue2.encoder.EventHeader
-
- RPCType - Enum in bdglue2.publisher.flume
-
Enum identifying which RPC protocol to use when talking to Flume.
- run() - Method in class bdglue2.encoder.EncoderThread
-
Execute the Encoder thread.
- run() - Method in class bdglue2.encoder.ParallelEncoder
-
This is the thread that harvests the encoded events
from each of the encoders' queues and sends them
onward for publishing.
- run() - Method in class bdglue2.publisher.ParallelPublisher
-
This is the thread that routes the encoded events
to the appropriate PublisherThread for delivery.
- run() - Method in class bdglue2.publisher.PublisherThread
-
Run the thread.
- SCHEMA_ID_UNSET - Static variable in class bdglue2.encoder.avro.AvroSchema
-
- SchemaDef - Class in bdglue2.utility.schemadef
-
A simple tool for generating schema meta data files for the target environment.
- SchemaDef() - Constructor for class bdglue2.utility.schemadef.SchemaDef
-
- SchemaDefPropertyValues - Class in bdglue2.utility.schemadef
-
The properties for SchemaDef.
- SchemaDefPropertyValues() - Constructor for class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
- sendToEncoder(DownstreamOperation) - Method in class bdglue2.encoder.EncoderThread
-
Convert the input operation into an event.
- sendToProducer() - Method in class bdglue2.publisher.kafka.KafkaHelper
-
Send the messageList to the Kafka Producer.
- sendToPublisher(EncoderThread) - Method in class bdglue2.encoder.ParallelEncoder
-
Pull the next event off of the specified encoder and
send it downstream for publishing.
- serialize(GenericRecord) - Method in class bdglue2.publisher.kafka.KafkaRegistry
-
Serialize as appropriate to send a record to Kafka that contains information
pertaining to the schema version that applies to this record.
- SET_DEFAULTS - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Specify whether to generate default values or not.
- SET_OPTYPE - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
specify whether to include a column for the operation
type (insert, update, delete).
- SET_POSITION - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Specify whether to include a column for the relative position of the op.
- SET_TABLENAME - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
specify whether to include a column for the table name
- SET_TIMESTAMP - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Specify whether to include a column for the operation timestamp.
- SET_TXID - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
specify whether to include a column for a transaction identifier (SCN)
- SET_USERTOKEN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
Specify whether to include a column for the operation user tokens.
- setAPIType(String) - Method in class bdglue2.publisher.nosql.NoSQLHelper
-
Set the API type (Table or KV API).
- setAvroColumnType(Schema.Type) - Method in class bdglue2.encoder.avro.column.AvroColumn
-
Override the default avro schema type with whatever
value was specified in the *.avsc file we read from disk.
- setBdglueTxInfo() - Method in class bdglue2.utility.schemadef.SchemaDef
-
Create columns for the transaction metadata information including
operation type and/or the transaction timestamp, etc.
- setColumns(DownstreamOperation, Op) - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
-
Set the column data values for the current operation.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroBoolean
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroColumn
-
Set the metadata type and the default Avro schema
type for this column.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroDateTime
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroDouble
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroFloat
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroInteger
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroLOB
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroLong
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroMultiByte
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroNumeric
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroString
-
Set the default values for this column type.
- setColumnType() - Method in class bdglue2.encoder.avro.column.AvroUnsupported
-
Set the default values for this column type.
- setDefaultValue(String) - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Set the default value for the column.
- setFileName(String) - Method in class bdglue2.utility.schemadef.Format
-
Set the name of the target output file.
- setFileSuffix(String) - Method in class bdglue2.utility.schemadef.Format
-
Set the file suffix that identifies the output file type.
- setFormat() - Method in class bdglue2.utility.schemadef.SchemaDef
-
Determine the proper formatter to invoke.
- setGG122TxInfo() - Method in class bdglue2.utility.schemadef.SchemaDef
-
This is a hack specific to GG "out of the box" processing.
- setHeaderInfo(DownstreamOperation) - Method in class bdglue2.encoder.EventHeader
-
Set the Avro event header information for this operation based
on the encoder and target types, etc.
- setHeaders(Map<String, String>) - Method in class bdglue2.encoder.EventData
-
Set the meta information in the header for this Event.
- setJdbcType(int) - Method in class bdglue2.meta.schema.DownstreamColumnMetaData
-
Override jdbc type where type mismatch is found at runtime.
- setJdbcType(int, String) - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Set the type for this column based on the incoming parameters.
- setKeyCol(boolean) - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Identify this column as a key column.
- setMessageKey(String) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
-
- setMessageKey(String) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
-
Set the message key value in use cases where it will always be the same
and not determined dynamically.
- setMessageKey(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
-
- setMessageKey(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
-
- setName(String) - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Set the column name.
- setNullable(String) - Method in class bdglue2.utility.schemadef.ColumnInfo
-
Indicate whether this column can be null.
- setProperty(String, String) - Method in class bdglue2.common.PropertyManagement
-
Set a property for this environment.
- setRowValues(EventData) - Method in class bdglue2.publisher.asynchbase.AsyncHbaseHelper
-
Loop through the data for this operation.
- setSchemaId(int) - Method in class bdglue2.encoder.avro.AvroSchema
-
Set the schema ID.
- setTopic(String) - Method in class bdglue2.publisher.kafka.KafkaMessageDefaultMeta
-
- setTopic(String) - Method in interface bdglue2.publisher.kafka.KafkaMessageHelper
-
Set the topic value in use cases where it will always be the same
and not determined dynamically.
- setTopic(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKey
-
- setTopic(String) - Method in class bdglue2.publisher.kafka.KafkaMessageTableKeyBb
-
- setUserTokens(DsOperation) - Method in class bdglue2.source.gghadoop.GG12HandlerMapper
-
Return a String containing a comma separated list of user tokens.
- SHORT_NAME - Static variable in class bdglue2.encoder.EventHeader
-
- shutdown(String) - Static method in class bdglue2.source.gghadoop.GG12Handler
-
Static function to allow a decision to stop processing to be made anywhere in the BDGlue code.
- size() - Method in class bdglue2.encoder.EventQueue
-
- status() - Method in class bdglue2.encoder.EncoderThread
-
Get a snapshot of current statistics for this thread.
- status() - Method in class bdglue2.encoder.EventQueue
-
Return the status of this queue formatted as a String.
- status() - Method in class bdglue2.encoder.ParallelEncoder
-
Generates the status of the encoder as a String.
- status() - Method in class bdglue2.publisher.ParallelPublisher
-
Get the current status of the thread as a String for logging purposes.
- status() - Method in class bdglue2.publisher.PublisherThread
-
- TABLE - Static variable in class bdglue2.encoder.EventHeader
-
- TABLENAME - Static variable in class bdglue2.BDGluePropertyValues
-
boolean: populate table name column.
- tablename() - Method in class bdglue2.encoder.MetadataHelper
-
Determines whether to include the table name in the record.
- TABLENAME_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
-
table name column name to use.
- TABLENAME_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The name for the generated tablename column.
- tablenameCol() - Method in class bdglue2.encoder.MetadataHelper
-
The column name to store the table name in.
- tables(String) - Method in class bdglue2.utility.schemadef.SchemaDef
-
Generate an array of table names from a String.
- take() - Method in class bdglue2.encoder.EncoderThread
-
Take an event from the outputQueue and return it.
- take() - Method in class bdglue2.encoder.EventQueue
-
Take an event off of this queue.
- TextEncoderHelper - Class in bdglue2.encoder
-
A helper class that handles basic escaping of special characters that might
cause problems when handled downstream.
- TextEncoderHelper() - Constructor for class bdglue2.encoder.TextEncoderHelper
-
- TIMESTAMP - Static variable in class bdglue2.encoder.EventHeader
-
- TIMESTAMP_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The name for the generated timestamp column.
- top(String, String, boolean) - Method in class bdglue2.utility.schemadef.Format
-
Format the "top" portion of the output file.
- top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatAvro
-
Format the top portion of the Avro schema file.
- top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatCassandra
-
Format the top portion of the Cassandra schema file.
- top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatHiveAvro
-
Format the top portion of the Hive schema file.
- top(String, String, boolean) - Method in class bdglue2.utility.schemadef.FormatNoSQL
-
Format the top portion of the NoSQL Table API schema file.
- TOPIC - Static variable in class bdglue2.encoder.EventHeader
-
- TOPIC_FLUME - Static variable in class bdglue2.publisher.kafka.KafkaProperties
-
The Flume event property that will contain the topic name.
- transactionBegin(DsEvent, DsTransaction) - Method in class bdglue2.source.gghadoop.GG12Handler
-
Called at the beginning of a transaction.
- transactionCommit(DsEvent, DsTransaction) - Method in class bdglue2.source.gghadoop.GG12Handler
-
If we are in transaction mode (i.e.
- transactionRollback(DsEvent, DsTransaction) - Method in class bdglue2.source.gghadoop.GG12Handler
-
Called if the transaction has to be rolled back for some reason.
- TX_OPTYPE - Static variable in class bdglue2.BDGluePropertyValues
-
boolean: populate operation type column.
- TX_OPTYPE_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
-
op type column name to use.
- TX_POSITION - Static variable in class bdglue2.BDGluePropertyValues
-
boolean: populate transaction relative position column.
- TX_POSITION_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
-
relative position column name to use.
- TX_TIMESTAMP - Static variable in class bdglue2.BDGluePropertyValues
-
boolean: populate transaction timestamp column.
- TX_TIMESTAMP_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
-
timestamp column name to use.
- TXID - Static variable in class bdglue2.BDGluePropertyValues
-
boolean: populate transaction id column.
- txId() - Method in class bdglue2.encoder.MetadataHelper
-
Determines whether to include a transaction identifier in the record.
- TXID_COLUMN - Static variable in class bdglue2.BDGluePropertyValues
-
transaxction id column name to use.
- TXID_COLUMN - Static variable in class bdglue2.utility.schemadef.SchemaDefPropertyValues
-
The name for the generated transaction ID column.
- txIdCol() - Method in class bdglue2.encoder.MetadataHelper
-
The column name to store the transaction id in.
- txOpType() - Method in class bdglue2.encoder.MetadataHelper
-
Determines whether to include operation type in the record.
- txOptypeCol() - Method in class bdglue2.encoder.MetadataHelper
-
Get the name of the operation type column.
- txPosition() - Method in class bdglue2.encoder.MetadataHelper
-
Determines whether to include position information in the record.
- txPositionCol() - Method in class bdglue2.encoder.MetadataHelper
-
The column name to store relative position data in.
- txTimestamp() - Method in class bdglue2.encoder.MetadataHelper
-
Determines whether to include timestamp information in the record.
- txTimestampCol() - Method in class bdglue2.encoder.MetadataHelper
-
Get the column name for timestamp information.
- validateDirectory(String) - Method in class bdglue2.encoder.avro.AvroSchema
-
Make sure that the directory exists, and if not, create it.
- validateDirectory(String) - Method in class bdglue2.utility.schemadef.Format
-
Make sure that the directory exists, and if not, create it.
- validName(String) - Method in class bdglue2.utility.schemadef.BigDataName
-
Convert a potentially invalid name to a valid one.
- valueOf(String) - Static method in enum bdglue2.encoder.avro.column.AvroColumnType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum bdglue2.encoder.EncoderType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum bdglue2.publisher.flume.RPCType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum bdglue2.publisher.nosql.NoSQLHelper.API_TYPE
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum bdglue2.publisher.PublisherType
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum bdglue2.encoder.avro.column.AvroColumnType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum bdglue2.encoder.EncoderType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum bdglue2.publisher.flume.RPCType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum bdglue2.publisher.nosql.NoSQLHelper.API_TYPE
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- values() - Static method in enum bdglue2.publisher.PublisherType
-
Returns an array containing the constants of this enum type, in
the order they are declared.
- versionInfo() - Method in class bdglue2.BDGlueVersion
-
Write the version info to stdout.