This blog post is about configuring druid to send metrics to graphite/grafana.
kindly refer to steps @
The Grafana dashboard templates are in above github link.
after you have followed the steps above, restart druid and it should send stuff to graphite and grafana.
You should see log statements like
INFO [main] io.druid.emitter.graphite.GraphiteEmitter - Starting Graphite Emitter.
INFO [GraphiteEmitter-0] io.druid.emitter.graphite.GraphiteEmitter - trying to connect to graphite server
INFO [main] io.druid.initialization.Initialization - Loading extension [graphite-emitter] for class
Tip: you can set the frequency at which metrics are reported and also set the types of monitors you wish to have BASED ON THE RELEASE version you USE.
Important Tip: Start off with JVM monitor first, then slowly add. The sys monitor needs sigar jar. some monitors mite nite work immediately.
recently encountered this error while generating a project in my intellij.
[ERROR] BUILD FAILURE
[INFO] : org.apache.maven.archetype.exception.UnknownArchetype: The desired archetype does not exist (org.apache.maven.archetypes:maven-archetype-webapp:RELEASE)
The desired archetype does not exist (org.apache.maven.archetypes:maven-archetype-webapp:RELEASE)
Solution: The archtypes are downloaded from the maven central repo, so make sure the repo is specified in your .m2/settings.xml
In the settings.xml, under profiles->profile->repositories add the maven central repo url
<profiles> <profile> <repositories>
<releases> <enabled>true</enabled> </releases>
</repositories> </profile> </profiles>
Tip: Check if the url ‘https://repo1.maven.org/maven2‘ works first , else give a repo which works.
recently i started pushing metrics to prometheus but whenever i sent a sample query to prometheus to see the data points, i would get none.
There were no errors in prometheus and i was scratching my head …. grrr…
I was on Mac OS and using a Docker image of Prometheus (version=1.7.1)
When i went into the docker container and checked the dateTime, walaaaaaaaaaaaa
There was a Time mismatch between host and Docker container.
#___7_day__difference__ –> Possible docker bug !!!
since i was searching in the current timebucket, and the datapoints were going to time bucket 7 days ago, i was not able to find em.
Restarting docker for Mac fixed the issue.
Recently i have been working with Druid & was trying to come up with the disk space sizing on the historical nodes, as we have to deploy onto remote customer locations, for which we need to come up with machine requests way in advance.
This took me into the world of bitmaps : concise and roaring.
Druid uses concise bitmaps by default and has the option for roaring too.
So after reading a bit i decided to come up with a calculator for Druid Segment Sizing needed on the druid HISTORICAL nodes assuming Concise is used.
You can find the calculator @ github.com/jaihind213/druid-calculator
PS: Initially i wanted to write a blog post explaining the logic behind my calculator, but was too lazy, so wrote code and included the rationale in the code comments. 🙂
Thank you and hope you find it useful. Feedback is welcome.
when you air conditioning is leaking and noise of water dropping is killing you.
you need an awesome Silencer Technology …. as they say necessity is the mother of invention …
so i came up with 🙂
Recently, i gave a presentation at Singapore Py-DataMeetup on “Demystifying Datastores”.
The main motivation of the presentation is to help one understand the various facets of a datatstore and how these facets can help you decide which one to use.
here is the link