Aerospike Notebooks Readme/Tips
For an interactive Jupyter notebook experience 
Here are some tips and tricks for ease of use and productive experience with Aerospike notebooks.
This notebook requires Aerospike
database running on localhost and that python and the Aerospike python
client have been installed (pip install aerospike). Visit Aerospike
notebooks
repo for
additional details and the docker container.
Learn about Jupyter Notebook
The Jupyter Notebook provides “a web-based application suitable for capturing the whole computation process: developing, documenting, and executing code, as well as communicating the results”. New to notebooks? Here is one source to learn more about the Jupyter Notebook.
Find and run Aerospike notebook.
Visit Aerospike notebooks repo to find additional Aerospike notebooks. To run another notebook, download the notebook from the repo to your local machine, and then click on File->Open, and select Upload.
Access shell commands
Use the ! line magic and %%bash cell magic to access shell commands.
That is, you can access a shell command on any line by prefixing it with
a ”!”, and an entire cell can have bash shell commands if it starts with
%%bash. Here are some examples:
# Accessing shell commands!ps!whoami# Start the Aerospike database.!asd >& /dev/null PID TTY TIME CMD 508 pts/0 00:00:00 psjovyan%%bash# bash cell# Check if the Aerospike database is running.pgrep -x asd >/dev/null && echo "Aerospike database is running" || echo "**Aerospike database is not running!**"ps -axu | grep asdAerospike database is runningjovyan 42 1.1 0.1 3581124 81956 ? Ssl 01:18 0:05 asdjovyan 520 0.0 0.0 6308 724 ? S 01:27 0:00 grep asdExamine server log
It is useful to examine the server log. Assuming it is located at /var/log/aerospike/aerospike.log, and you have the permissions, you can run the following to view the last 10 lines of the log. (Adjust the log path to your setting.)
# View the last 10 lines of the log:!echo "End of server log:"; tail -10 /var/log/aerospike/aerospike.logEnd of server log:Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 2: /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0) [0x7ff4a56d13c0]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 3: /lib/x86_64-linux-gnu/libpthread.so.0(raise+0xcb) [0x7ff4a56d124b]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 4: asd(cf_log_write_no_return+0x97) [0x5601cc0f7ab6]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 5: asd(xmem_delete_namespace_blocks+0x1ed) [0x5601cbe9f33a]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 6: asd(as_namespaces_setup+0x37f) [0x5601cbe9fd7e]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 7: asd(as_namespaces_init+0x18) [0x5601cbee6203]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 8: asd(as_run+0x326) [0x5601cbeb7bf5]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 9: asd(main+0xd) [0x5601cbe9a803]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 10: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3) [0x7ff4a50f10b3]Jan 22 2021 01:27:00 GMT: WARNING (as): (log.c:628) stacktrace: frame 11: asd(_start+0x2e) [0x5601cbe9b10e]View database state.
The command line tool “aql” can be very handy to examine the data and metadata in the database. For a more complete description of the capabilities, see the doc. Assuming the database has namespace “test”, the following commands can be executed.
# Insert a record in set "demo" in namsepace "test" with Primary Key (PK) 1 and a bin or field "testbin"# with value "hello world!".!aql -c "INSERT INTO test.demo (PK, 'testbin') VALUES (1, 'hello world!')"# View all records in the set.!aql -c "SELECT * FROM test.demo"# Delete the record!aql -c "DELETE FROM test.demo WHERE PK = 1"!aql -c "SELECT * FROM test.demo"INSERT INTO test.demo (PK, 'testbin') VALUES (1, 'hello world!')OK, 1 record affected.
SELECT * FROM test.demo+----------------+| testbin |+----------------+| "hello world!" |+----------------+1 row in set (0.168 secs)
OK
DELETE FROM test.demo WHERE PK = 1OK, 1 record affected.
SELECT * FROM test.demo0 rows in set (0.153 secs)
OKView cluster state.
Another useful utility is asadm which can be used to view various aspects of the database cluster. For a more complete description of its capabilities, see the doc.
# Show the features enabled in this database.!asadm -e "features"# Display summary info for the cluster!asadm -e "summary"# View the config!asadm -e "show config"Seed: [('127.0.0.1', 3000, None)]Config_file: /home/jovyan/.aerospike/astools.conf, /etc/aerospike/astools.conf~~~~~~~~~~~~~~~~~~~~~~~Features (2021-01-22 01:27:05 UTC)~~~~~~~~~~~~~~~~~~~~~~~NODE : jupyter-aerospike-2daeros-2dotebooks-2edocker-2djxk71mnd:3000AGGREGATION : NOBATCH : NOINDEX-ON-DEVICE: NOINDEX-ON-PMEM : NOKVS : YESLDT : NOQUERY : NORACK-AWARE : NOSC : NOSCAN : YESSECURITY : NOSINDEX : NOTLS (FABRIC) : NOTLS (HEARTBEAT): NOTLS (SERVICE) : NOUDF : NOXDR DESTINATION: NOXDR SOURCE : NO
Seed: [('127.0.0.1', 3000, None)]Config_file: /home/jovyan/.aerospike/astools.conf, /etc/aerospike/astools.confCluster=======
1. Server Version : E-5.4.0.1 2. OS Version : Ubuntu 20.04.1 LTS (4.19.150+) 3. Cluster Size : 1 4. Devices : Total 1, per-node 1 5. Memory : Total 1.000 GB, 0.00% used (0.000 B), 100.00% available (1.000 GB) 6. Disk : Total 4.000 GB, 0.00% used (0.000 B), 99.00% available contiguous space (3.960 GB) 7. Usage (Unique Data): None 8. Active Namespaces : 0 of 1 9. Features : KVS, Scan
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Namespaces~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Namespace Devices Memory Disk Replication Rack Master . (Total,Per-Node) (Total,Used%,Avail%) (Total,Used%,Avail%) Factor Aware Objectstest (1, 1) (1.000 GB, 0.00, 100.00) (4.000 GB, 0.00, 99.00) 2 False 0.000Number of rows: 1
Seed: [('127.0.0.1', 3000, None)]Config_file: /home/jovyan/.aerospike/astools.conf, /etc/aerospike/astools.conf~~~~~~~~~~~~~~~~~~~~~~~~~Service Configuration (2021-01-22 01:27:09 UTC)~~~~~~~~~~~~~~~~~~~~~~~~~~NODE : jupyter-aerospike-2daeros-2dotebooks-2edocker-2djxk71mnd:3000advertise-ipv6 : falseauto-pin : nonebatch-index-threads : 8batch-max-buffers-per-queue : 255batch-max-requests : 5000batch-max-unused-buffers : 256batch-without-digests : falsecluster-name : nulldebug-allocations : nonedisable-udf-execution : falseenable-benchmarks-fabric : falseenable-health-check : falseenable-hist-info : falseenable-ldap : falseenable-security : falsefabric.address : anyfabric.channel-bulk-fds : 2fabric.channel-bulk-recv-threads : 4fabric.channel-ctrl-fds : 1fabric.channel-ctrl-recv-threads : 4fabric.channel-meta-fds : 1fabric.channel-meta-recv-threads : 4fabric.channel-rw-fds : 8fabric.channel-rw-recv-pools : 1fabric.channel-rw-recv-threads : 16fabric.keepalive-enabled : truefabric.keepalive-intvl : 1fabric.keepalive-probes : 10fabric.keepalive-time : 1fabric.latency-max-ms : 5fabric.port : 3001fabric.recv-rearm-threshold : 1024fabric.send-threads : 8fabric.tls-name : nullfabric.tls-port : 0feature-key-file : /etc/aerospike/features.confheartbeat.address : anyheartbeat.connect-timeout-ms : 500heartbeat.interval : 150heartbeat.mode : meshheartbeat.mtu : 1460heartbeat.port : 3002heartbeat.protocol : v3heartbeat.timeout : 10heartbeat.tls-name : nullheartbeat.tls-port : 0indent-allocations : falseinfo-threads : 16info.address : anyinfo.port : 3003keep-caps-ssd-health : falseldap-login-threads : 8ldap.disable-tls : falseldap.polling-period : 300ldap.query-base-dn : nullldap.query-user-dn : nullldap.query-user-password-file : nullldap.role-query-base-dn : nullldap.role-query-search-ou : falseldap.server : nullldap.session-ttl : 86400ldap.tls-ca-file : nullldap.token-hash-method : sha-256ldap.user-dn-pattern : nullldap.user-query-pattern : nulllog-local-time : falselog-millis : falsemicrosecond-histograms : falsemigrate-fill-delay : 0migrate-max-num-incoming : 4migrate-threads : 1min-cluster-size : 1node-id : BB906214131EE62node-id-interface : nullpaxos-single-replica-limit : 1pidfile : /var/run/aerospike/asd.pidprivilege-refresh-period : 300proto-fd-idle-ms : 0proto-fd-max : 15000proto-slow-netio-sleep-ms : 1query-batch-size : 100query-buf-size : 2097152query-bufpool-size : 256query-in-transaction-thread : falsequery-long-q-max-size : 500query-microbenchmark : falsequery-pre-reserve-partitions : falsequery-priority : 10query-priority-sleep-us : 1query-rec-count-bound : 18446744073709551615query-req-in-query-thread : falsequery-req-max-inflight : 100query-short-q-max-size : 500query-threads : 6query-threshold : 10query-untracked-time-ms : 1000query-worker-threads : 15report-authentication-sinks : 0report-data-op-sinks : 0report-sys-admin-sinks : 0report-user-admin-sinks : 0report-violation-sinks : 0run-as-daemon : truescan-max-done : 100scan-threads-limit : 128service-threads : 8service.access-port : 0service.address : anyservice.alternate-access-port : 0service.port : 3000service.tls-access-port : 0service.tls-alternate-access-port: 0service.tls-name : nullservice.tls-port : 0sindex-builder-threads : 4sindex-gc-max-rate : 50000sindex-gc-period : 10stay-quiesced : falsesyslog-local : -1ticker-interval : 10transaction-max-ms : 1000transaction-retry-ms : 1002vault-ca : nullvault-path : nullvault-token-file : nullvault-url : nullwork-directory : /opt/aerospike
~~~~~~~~~~~~~~~~~~~~~~~~~Network Configuration (2021-01-22 01:27:09 UTC)~~~~~~~~~~~~~~~~~~~~~~~~~~NODE : jupyter-aerospike-2daeros-2dotebooks-2edocker-2djxk71mnd:3000fabric.address : anyfabric.channel-bulk-fds : 2fabric.channel-bulk-recv-threads : 4fabric.channel-ctrl-fds : 1fabric.channel-ctrl-recv-threads : 4fabric.channel-meta-fds : 1fabric.channel-meta-recv-threads : 4fabric.channel-rw-fds : 8fabric.channel-rw-recv-pools : 1fabric.channel-rw-recv-threads : 16fabric.keepalive-enabled : truefabric.keepalive-intvl : 1fabric.keepalive-probes : 10fabric.keepalive-time : 1fabric.latency-max-ms : 5fabric.port : 3001fabric.recv-rearm-threshold : 1024fabric.send-threads : 8fabric.tls-name : nullfabric.tls-port : 0heartbeat.address : anyheartbeat.connect-timeout-ms : 500heartbeat.interval : 150heartbeat.mode : meshheartbeat.mtu : 1460heartbeat.port : 3002heartbeat.protocol : v3heartbeat.timeout : 10heartbeat.tls-name : nullheartbeat.tls-port : 0info.address : anyinfo.port : 3003service.access-port : 0service.address : anyservice.alternate-access-port : 0service.port : 3000service.tls-access-port : 0service.tls-alternate-access-port: 0service.tls-name : nullservice.tls-port : 0
~~~~~~~~~~~~~~~~~~~~~~~~~~test Namespace Configuration (2021-01-22 01:27:09 UTC)~~~~~~~~~~~~~~~~~~~~~~~~~~NODE : jupyter-aerospike-2daeros-2dotebooks-2edocker-2djxk71mnd:3000allow-ttl-without-nsup : falsebackground-scan-max-rps : 10000conflict-resolution-policy : generationconflict-resolve-writes : falsedata-in-index : falsedefault-ttl : 2592000disable-cold-start-eviction : falsedisable-write-dup-res : falsedisallow-null-setname : falseenable-benchmarks-batch-sub : falseenable-benchmarks-ops-sub : falseenable-benchmarks-read : falseenable-benchmarks-udf : falseenable-benchmarks-udf-sub : falseenable-benchmarks-write : falseenable-hist-proxy : falseevict-hist-buckets : 10000evict-tenths-pct : 5geo2dsphere-within.earth-radius-meters : 6371000geo2dsphere-within.level-mod : 1geo2dsphere-within.max-cells : 12geo2dsphere-within.max-level : 30geo2dsphere-within.min-level : 1geo2dsphere-within.strict : truehigh-water-disk-pct : 0high-water-memory-pct : 0ignore-migrate-fill-delay : falseindex-stage-size : 1073741824index-type : shmemmemory-size : 1073741824migrate-order : 5migrate-retransmit-ms : 5000migrate-sleep : 1nsid : 0nsup-hist-period : 3600nsup-period : 120nsup-threads : 1partition-tree-sprigs : 256prefer-uniform-balance : truerack-id : 0read-consistency-level-override : offreject-non-xdr-writes : falsereject-xdr-writes : falsereplication-factor : 2sindex.num-partitions : 32single-bin : falsesingle-scan-threads : 4stop-writes-pct : 90storage-engine : devicestorage-engine.cache-replica-writes : falsestorage-engine.cold-start-empty : falsestorage-engine.commit-min-size : 0storage-engine.commit-to-device : falsestorage-engine.compression : nonestorage-engine.compression-level : 0storage-engine.data-in-memory : truestorage-engine.defrag-lwm-pct : 50storage-engine.defrag-queue-min : 0storage-engine.defrag-sleep : 1000storage-engine.defrag-startup-minimum : 10storage-engine.direct-files : falsestorage-engine.disable-odsync : falsestorage-engine.enable-benchmarks-storage : falsestorage-engine.encryption-key-file : nullstorage-engine.file[0] : /opt/aerospike/data/test.datstorage-engine.filesize : 4294967296storage-engine.flush-max-ms : 1000storage-engine.max-write-cache : 67108864storage-engine.min-avail-pct : 5storage-engine.post-write-queue : 0storage-engine.read-page-cache : falsestorage-engine.scheduler-mode : nullstorage-engine.serialize-tomb-raider : falsestorage-engine.sindex-startup-device-scan: falsestorage-engine.tomb-raider-sleep : 1000storage-engine.write-block-size : 1048576strong-consistency : falsestrong-consistency-allow-expunge : falsetomb-raider-eligible-age : 86400tomb-raider-period : 86400transaction-pending-limit : 20truncate-threads : 4write-commit-level-override : offxdr-bin-tombstone-ttl : 86400xdr-tomb-raider-period : 120xdr-tomb-raider-threads : 1Next steps
Visit Aerospike notebooks repo to run additional Aerospike notebooks. To run a different notebook, download the notebook from the repo to your local machine, and then click on File > Open, and select Upload.