Support Center

Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Receiving HTTP 504 error when indexing a large number of documents

Ben Symonds Aug 09, 2017 06:00PM +03

Hello. I have your addon provisioned via Heroku. I am trying to index ~400,000 documents (in series, not parallel) but only get part of the way through until I receive a HTTP 504 error ("gateway timeout"). I have tried a few times, a couple of last week and once today. I don't think this should be happening. Please can you advise? Thanks.

Up 0 rated Down
Ferhat Sobay Aug 09, 2017 06:06PM +03 Searchly Agent
Hi Ben,

Are you using bulk api ? If so what is your document count per bulk request?

Best,
Ferhat
Up 0 rated Down
Ben Symonds Aug 10, 2017 12:35PM +03
Hi Ferhat, thanks for your reply.

Actually this isn't using bulk api, although now you mention it it probably does make sense to that, so I'll investigate. But even so, I should be able to index each document individually and not receive an error, right?
Up 0 rated Down
Ferhat Sobay Aug 11, 2017 12:09PM +03 Searchly Agent
Hi Ben,

You should not receive that error, you are right.

We can investigate if you send account information.

Best,
Ferhat
Up 0 rated Down
Ben Symonds Aug 11, 2017 12:21PM +03
Hi Ferhat,

Great, thanks, that would be useful. The account is app63653509@heroku.com (I think that's the account name, anyway). I assume you can see my email address on this post..? Feel free to contact me there if we need to discuss things which shouldn't be on this public forum!

Thanks,

Ben
Up 0 rated Down
Ben Symonds Aug 21, 2017 12:12PM +03
Hi Ferhat,

Do you have any update on this?

Ben
Up 0 rated Down
Ben Symonds Sep 11, 2017 02:49PM +03
Still no update? If we can't call elasticsearch without getting errors, we will just switch to a different provider...

Post Your Public Answer

Your name (required)
Your email address (required)
Answer (required)
support@searchly.com
http://assets2.desk.com/
false
searchboxio
Loading
seconds ago
a minute ago
minutes ago
an hour ago
hours ago
a day ago
days ago
about
false
Invalid characters found
/customer/en/portal/articles/autocomplete