This post appeared originally in our sysadvent series and has been moved here following the discontinuation of the sysadvent microsite
pv is a nice little tool that will take stdin and make a nice little
progress bar and displaying time elapsed, percentage completed (if size is known)
current throughput rate and the total data transferred and with an ETA.
So if you have a tool that can output it’s result on standard output or read from standard input, one can get a progress bar!
It’s nice to know that “data is flowing”.
Other examples
Send file with Netcat and get a nice progress-bar:
pv file | nc -w 1 example.com 3000
Get progress bar on tar output:
tar zcf - /directory | pv > backup.tar.gz
MySQL dump/restore:
mysqldump database | pv > database.sql
pv database.sql | mysql database
Limit the transfer rate and size of data over a pipe
cat /dev/zero | pv -L 3m -Ss 100m > /dev/null
Ontology: A Guide to Understanding and Structuring Data
Generative AI models are now embedded in everyday life, fueling major enthusiasm across enterprises and startups. As demand accelerates, organizations continue to invest heavily in AI-led products and services. Yet one question remains unresolved: Why do 85% of AI projects still fail?
The causes are technical, but the pattern is consistent: systems struggle with fragmented, complex data and fail to extract reliable meaning from it. That leads to a foundational question: What is an ontology, and how does it help ... [continue reading]