Describe the feature

When doing result = session.client("dynamodb").query(**kwargs), have an option to skip json-parsing of the output to speed up collection of results.

Use Case

We are loading on the order of thousands of items from DynamoDB using aioboto3/aiobotocore. Each item is ~16KB, and we combine/filter items and forward them to a client. We noticed that in a loop retrieving these items, AioJSONParser.parse is the largest contributor of the time (as measured by pyinstrument).
botocore took 50 s for 1000 dynamodb queries (20% inside JSONParser.parse)

Proposed Solution

One possibility is to have a keyword argument for client and/or resource calls that turns off parsing that allows the user to receive the raw body of the response.

Other Information

botocore:

import json
from botocore.session import get_session

def main():
    session = get_session()
    tasks = []
    query_kwarg_list = json.load(open("kwargs.json"))
    assert len(query_kwarg_list) == 1000
    client = session.create_client("dynamodb")
    for kwargs in query_kwarg_list:
        tasks.append(client.query(**kwargs))
    result = tasks
    assert len(result) == 1000


if __name__ == "__main__":
    main()

aiobotocore:

import asyncio
import json
from aiobotocore.session import get_session

async def main():
    session = get_session()
    tasks = []
    query_kwarg_list = json.load(open("kwargs.json"))
    assert len(query_kwarg_list) == 1000
    async with session.create_client("dynamodb") as client:
        for kwargs in query_kwarg_list:
            tasks.append(client.query(**kwargs))
        result = await asyncio.gather(*tasks)
    assert len(result) == 1000


if __name__ == "__main__":
    loop = asyncio.get_event_loop()
    loop.run_until_complete(main())

Cf: aio-libs/aiobotocore#1132

Acknowledgements

• I may be able to implement this feature request

  This feature might incur a breaking change
  To pick up a draggable item, press the space bar. While dragging, use the arrow keys to move the item. Press space again to drop the item in its new position, or press escape to cancel.

SDK version used

1.34.131 and higher

Environment details (OS name and version, etc.)

python 3.10, 3.11; Ubuntu 20.04