Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simulating real time feed #3

Open
withersdb opened this issue May 12, 2016 · 2 comments
Open

Simulating real time feed #3

withersdb opened this issue May 12, 2016 · 2 comments

Comments

@withersdb
Copy link

I'm trying to simulate a live feed of event data to Kafka. I tried running with the following config, following the example of this Confluent demo:

bin/eventsim -c "examples/example-config.json" /
-start-time "`date +"%Y-%m-%dT%H:%M:%S"`" /
--end-time "2016-05-18T17:00:00" --nusers 2000 /
--kafkaBrokerList broker1:9092 --kafkaTopic eventsim /
--continuous

Which provides the output "starting to generate events," but no messages are being published. Publishing simulated historical data (i.e. with a past start and end time) to Kafka all at once works fine. Could you add an example to the documentation about how to start a real time simulated event stream?

@emptyr1
Copy link

emptyr1 commented Jun 9, 2016

@withersdb Any luck with this?

@SeanBE
Copy link

SeanBE commented Apr 9, 2017

I needed something similar. When the continuous flag is set, the thread will sleep the difference between current sys time and the last generated event's time stamp. With a start date and end date that differ by a few minutes, the first event's time stamp was oddly set to 15 days ago. The thread would be sleeping for ~360 hours. That would explain your issue. I'm looking into a fix.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants