Brokers
Time (sec)
Exit Code
Command
StdOutput
StdError
Create Topic (basic kafka)
1.18
0
kafka-topics --zookeeper cloudera.landoop.com:2181/confluent --topic coyote_test_01 --partition 3 --replication 1 --create
List Topics (basic kafka)
1.00
0
kafka-topics --zookeeper cloudera.landoop.com:2181/confluent --list
Performance Test (basic kafka)
20.83
0
kafka-producer-perf-test --topic coyote_test_01 --throughput 100000 --record-size 1000 --num-records 2000000 --producer-props bootstrap.servers="cloudera.landoop.com:9092"
Passed 3 out of 3
23.01 seconds
REST Proxy
Time (sec)
Exit Code
Command
StdOutput
StdError
List Topics (rest proxy)
0.20
0
curl -vs --stderr - "http://cloudera.landoop.com:8082/topics"
Topic Information (rest proxy)
0.15
0
curl -vs --stderr - "http://cloudera.landoop.com:8082/topics/coyote_test_01"
Topic Partitions (rest proxy)
0.04
0
curl -vs --stderr - "http://cloudera.landoop.com:8082/topics/coyote_test_01/partitions"
Delete Topic (basic kafka)
1.00
0
kafka-topics --zookeeper cloudera.landoop.com:2181/confluent --topic coyote_test_01 --delete
Produce Avro Message (rest proxy, schema registry)
0.77
0
curl -vs --stderr - -XPOST -H "Content-Type: application/vnd.kafka.avro.v1+json" --data '{"value_schema": "{\"type\": \"record\", \"name\": \"User\", \"fields\": [{\"name\": \"name\", \"type\": \"string\"}]}", "records": [{"value": {"name": "testUser"}}]}' "http://cloudera.landoop.com:8082/topics/coyote_test_avro"
Create Consumer for Avro data (rest proxy, schema registry)
0.12
0
curl -vs --stderr - -XPOST -H "Content-Type: application/vnd.kafka.v1+json" --data '{"name": "a_consumer", "format": "avro", "auto.offset.reset": "smallest"}' "http://cloudera.landoop.com:8082/consumers/coyote_avro"
Consume Avro Message (rest proxy, schema registry)
1.03
0
curl -vs --stderr - -XGET -H "Accept: application/vnd.kafka.avro.v1+json" "http://cloudera.landoop.com:8082/consumers/coyote_avro/instances/a_consumer/topics/coyote_test_avro"
Delete Avro Consumer (rest proxy, schema registry)
0.04
0
curl -vs --stderr - -X DELETE "http://cloudera.landoop.com:8082/consumers/coyote_avro/instances/a_consumer"
Produce JSON Message (rest proxy)
0.26
0
curl -vs --stderr - -XPOST -H "Content-Type: application/vnd.kafka.json.v1+json" --data '{"records":[{"value":{"foo":"bar"}}]}' "http://cloudera.landoop.com:8082/topics/coyote_test_json"
Create Consumer for JSON data (rest proxy)
0.04
0
curl -vs --stderr - -XPOST -H "Content-Type: application/vnd.kafka.v1+json" --data '{"name": "a_consumer", "format": "json", "auto.offset.reset": "smallest"}' "http://cloudera.landoop.com:8082/consumers/coyote_json"
Consume JSON Message (rest proxy)
1.02
0
curl -vs --stderr - -XGET -H "Accept: application/vnd.kafka.json.v1+json" \ "http://cloudera.landoop.com:8082/consumers/coyote_json/instances/a_consumer/topics/coyote_test_json"
Delete JSON Consumer (rest proxy)
0.02
0
curl -vs --stderr - -X DELETE "http://cloudera.landoop.com:8082/consumers/coyote_json/instances/a_consumer"
Produce Binary Message (rest proxy)
0.26
0
curl -vs --stderr - -XPOST -H "Content-Type: application/vnd.kafka.binary.v1+json" --data '{"records":[{"value":"S2Fma2E="}]}' "http://cloudera.landoop.com:8082/topics/coyote_test_binary"
Create Consumer for Binary data (rest proxy)
0.03
0
curl -vs --stderr - -XPOST -H "Content-Type: application/vnd.kafka.v1+json" --data '{"name": "a_consumer", "format": "binary", "auto.offset.reset": "smallest"}' "http://cloudera.landoop.com:8082/consumers/coyote_binary"
Consume Binary Message (rest proxy)
1.02
0
curl -vs --stderr - -XGET -H "Accept: application/vnd.kafka.binary.v1+json" \ "http://cloudera.landoop.com:8082/consumers/coyote_binary/instances/a_consumer/topics/coyote_test_binary"
Delete Binary Consumer (rest proxy)
0.02
0
curl -vs --stderr - -XDELETE "http://cloudera.landoop.com:8082/consumers/coyote_binary/instances/a_consumer"
Passed 16 out of 16
6.03 seconds
Schema Registry
Time (sec)
Exit Code
Command
StdOutput
StdError
Register a new Schema version (schema registry)
0.02
0
curl -vs --stderr - -XPOST -i -H "Content-Type: application/vnd.schemaregistry.v1+json" --data '{"schema": "{\"type\": \"string\"}"}' "http://cloudera.landoop.com:8081/subjects/coyote_test_01/versions"
List subjects (schema registry)
0.08
0
curl -vs --stderr - -XGET -i "http://cloudera.landoop.com:8081/subjects"
List Schema versions (schema registry)
0.02
0
curl -vs --stderr - -XGET -i "http://cloudera.landoop.com:8081/subjects/coyote_test_01/versions"
Fetch Schema by name and version (schema registry)
0.02
0
curl -vs --stderr - -XGET -i "http://cloudera.landoop.com:8081/subjects/coyote_test_01/versions/1"
Register Complex Schema (schema registry)
0.02
0
curl -vs --stderr - -XPOST -i -H "Content-Type: application/vnd.schemaregistry.v1+json" --data '{"schema": "{\"type\": \"record\", \"name\": \"User\", \"fields\": [{\"name\": \"name\", \"type\": \"string\"}]}"}' "http://cloudera.landoop.com:8081/subjects/coyote_test_02/versions"
Test Schema Compatibility (schema registry)
0.03
0
curl -vs --stderr - -XPOST -i -H "Content-Type: application/vnd.schemaregistry.v1+json" --data '{"schema": "{\"type\": \"record\", \"name\": \"User\", \"fields\": [{\"name\": \"name\", \"type\": \"string\"}, {\"name\": \"address\", \"type\": \"string\"}]}"}' "http://cloudera.landoop.com:8081/compatibility/subjects/coyote_test_02/versions/latest"
Get Schema Registry Configuration (schema registry)
0.02
0
curl -vs --stderr - -XGET -i "http://cloudera.landoop.com:8081/config"
Passed 7 out of 7
0.21 seconds
Connect
Time (sec)
Exit Code
Command
StdOutput
StdError
Get list of Connectors (connect distributed)
0.20
0
curl -vs --stderr - -XGET -i "http://cloudera.landoop.com:8085/connectors"
Create a Console Connector (connect distributed)
0.64
0
curl -vs --stderr - -X POST -H "Content-Type: application/json" --data '{ "name": "coyote_test_console_source-1469568524243", "config": {"connector.class":"org.apache.kafka.connect.file.FileStreamSourceConnector","tasks.max":"1","topic":"coyote_connect_distributed_test-1469568524243","file":"/etc/fstab"}}' "http://cloudera.landoop.com:8085/connectors"
Get Connector s Configuration (connect distributed)
0.05
0
curl -vs --stderr - -XGET -i "http://cloudera.landoop.com:8085/connectors/coyote_test_console_source-1469568524243"
kafconcli (kafconcli, connect distributed)
1.55
0
kafconcli get -e "http://cloudera.landoop.com:8085" coyote_test_console_source-1469568524243
Run Console Consumer to fix Kafka's transient state (basic kafka)
5.39
(ignore) 124
timeout 5 kafka-console-consumer --new-consumer --bootstrap-server cloudera.landoop.com:9092 --topic coyote_connect_distributed_test-1469568524243 --from-beginning
Processed a total of 11 messages
Run Console Consumer (basic kafka)
5.40
(ignore) 124
timeout 5 kafka-console-consumer --new-consumer --bootstrap-server cloudera.landoop.com:9092 --topic coyote_connect_distributed_test-1469568524243 --from-beginning
Processed a total of 11 messages
Delete connector
0.52
0
curl -vs --stderr - -XDELETE "http://cloudera.landoop.com:8085/connectors/coyote_test_console_source-1469568524243"
Delete Connect Distributes Test Topic (basic kafka)
1.00
0
kafka-topics --zookeeper cloudera.landoop.com:2181/confluent --topic coyote_connect_distributed_test-1469568524243 --delete
Create and Init SQLite database
0.01
0
sqlite3 coyote_test.sqlite
Create coyote_sqlite_connector.properties
0.00
0
tee coyote_sqlite_connector.properties
Create coyote_connect_standalone.properties
0.00
0
tee coyote_connect_standalone.properties
Read SQLite into Topic (connect standalone)
20.09
(ignore) 124
timeout 9 connect-standalone coyote_connect_standalone.properties coyote_sqlite_connector.properties
Run Console Consumer (basic kafka)
5.39
(ignore) 124
timeout 5 kafka-console-consumer --new-consumer --bootstrap-server cloudera.landoop.com:9092 --topic coyote-test-connect-standalone-accounts --from-beginning
Processed a total of 2 messages
Delete Connect Standalone Test Topic (basic kafka)
0.99
0
kafka-topics --zookeeper cloudera.landoop.com:2181/confluent --topic coyote-test-connect-standalone-accounts --delete
Passed 14 out of 14
41.23 seconds