cube-js/cube

Cube.js not waiting for response from Elasticsearch

Open

#1,183 opened on Oct 7, 2020

View on GitHub
 (1 comment) (0 reactions) (0 assignees)Rust (19,563 stars) (1,965 forks)batch import
community supporteddriver:elasticsearchhelp wanted

Description

Describe the bug While trying to call elasticsearch to get the data into cube.js. It usually takes 5 to 10 seconds to get the response as the volume of data is huge (~ 120 million), but cube.js is not waiting until it gets the response. Also, we could see that the elasticsearch SQL query is still running in the cube.js console and we can get the response into the cube.js the second time as it's already fetched and stored in cube.js cache.

Expected behavior Cube.js must wait until it gets the response from elasticsearch or an option to override the default wait timeout before pushing to cube.js cache.

Contributor guide

Tech stack
javascriptnodejselasticsearch
Domain
backenddatabase
Issue type
bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
Basic knowledge of Cube.jsUnderstanding of Elasticsearch queries
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30
Research direction
Investigate the Cube.js Elasticsearch driver or query execution code to understand why the query does not wait for the response. Look for any timeout settings or async handling issues, especially in files related to the Elasticsearch query execution. The issue mentions that the query runs successfully on the second attempt due to caching, so focus on the initial query flow and how Cube.js handles long running queries. Check if there is a configurable timeout option that needs to be added or adjusted.