MD5 Filter

The foglamp-filter-md5 plugin computes a MD5 hash of a reading’s JSON representation and stores the hash as a new datapoint within the reading. This allows verification of the data integrity in order to detect potential modifications to the data later in the data pipeline.

This filter is useful for:

  • Verifying if readings have been modified since the point in the pipeline at which the filter added the MD5.

  • Providing a mechanism to verify whether a reading has been altered.

  • Enabling data tampering detection when used alongside foglamp-filter-md5verify.

The name of the datapoint to which the MD5 hash is written can be set via the plugin configuration. The default datapoint name is MD5.

Note

The MD5 hash includes the name and value of all datapoints in the reading. This ensures name changes, value changes, addition or removal of a datapoint will be detected.

Adding the MD5 Filter

MD5 filters are added in the same way as any other filters:

md5

  • MD5 Datapoint Name : Name for the data point to hold the MD5 hash value

  • Enabled : Enable or Disable Filter

  • Click Done to activate it

See Also

foglamp-filter-amber - A FogLAMP filter to pass data to the Boon Logic Nano clustering engine

foglamp-filter-asset-validation - A plugin for performing basic sanity checking on the data flowing in the pipeline.

foglamp-filter-batch-label - A filter to attach batch labels to the data. Batch numbers are updated based on conditions seen in the data stream.

foglamp-filter-conditional-labeling - Attach labels to the reading data based on a set of expressions matched against the data stream.

foglamp-filter-enumeration - A filter to map between symbolic names and numeric values in a datapoint.

foglamp-filter-inventory - A plugin that can inventory the data that flows through a FogLAMP pipeline.

foglamp-filter-md5verify - FogLAMP MD5 Verify plugin verifies the integrity of readings by computing a new MD5 hash and comparing it against the stored MD5 datapoint.

foglamp-filter-metadata - A FogLAMP processing filter plugin that adds metadata to the readings in the data stream

foglamp-filter-sha2 - FogLAMP sha2 filter computes a SHA-2 hash of a reading’s JSON representation and stores the hash as a new datapoint within the reading.

foglamp-filter-sha2verify - FogLAMP SHA2 Verify plugin verifies the integrity of readings by computing a new SHA-2 hash and comparing it against the stored SHA-2 datapoint.

foglamp-filter-sigmacleanse - A data cleansing plugin that removes data that differs from the mean value by more than x sigma