Mongo DB Storage Plugin : performance slow

Open
#2,906 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Stale
Tech stack
java, mongodb, sql
Domain
databases

Research direction

Start by reproducing the sample Apache Drill query against the MongoDB collection with the datetime index described in the issue. Inspect whether the index is used during execution and compare the filtered query's behavior with the reported slow retrieval. Done means the index-use behavior is explained and a specific, verifiable change or documented limitation is identified.

Written by the indexing model from the issue text.

Description

bug

Hi Team,

I'm attempting to retrieve a large collection of data and apply filtering based on datetime, but the performance is quite slow. Despite adding a datetime filter index to the MongoDB collection, it seems that the index is not being utilized by drill.

Please find the sample query which i am executing from apache drill

select * FROM mongo.sampletable
WHERE SentTime >= TO_TIMESTAMP('2023-08-10 00:00:00', 'yyyy-MM-dd HH:mm:ss')
AND SentTime < TO_TIMESTAMP('2023-08-17 00:00:00', 'yyyy-MM-dd HH:mm:ss')
LIMIT 10

any leads will be apricated.

Thanks

Dominant language
Java
Stars
2k
Forks
989
Avg merge
1d 8h
Merged PRs (30d)
5

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from apache/drill

All issues in apache/drill

Similar issues

More Java issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.