Uploader has insufficient jitter for large deployments.

[ghstwhl]

While jitter was added to the uploader in 2.3.136.0, the jitter window is only 30 seconds. We are seeing spikes of errors every 30 minutes as our deployment exhausts the PutInventory API quota. If increasing the jitter would increase a window of inaccessibility for the agent, perhaps a random time offset could be applied to the initial scheduling, so that the inventory upload events are not scheduled for x:00 and X:30.

amazon-ssm-agent/agent/plugins/inventory/datauploader/uploader.go

Lines 134 to 147 in 3dee01c

	// Get one random jitter time before calling PutInventory API to prevent huge number of request come to
	// the backend service in the same time.
	// Use current Time stamp + Hashcode of instance ID as random key
	// The jitter window is in 0-30 seconds.
	func getRandomBackOffTime(context context.T, instanceID string) (sleepTime int) {
	log := context.Log()
	hash := fnv.New32a()
	hash.Write([]byte(instanceID))
	rand.Seed(time.Now().Unix() + int64(hash.Sum32()))
	sleepTime = rand.Intn(Max_Time_TO_Back_Off)
	log.Debugf("Random back off: %v seconds before call put inventory", sleepTime)
	return sleepTime
	}