twitch.py

Line 856
# 'ComscoreStreamingQuery': 'e1edae8122517d013405f237ffcc124515dc6ded82480a88daef69c83b53ac01',

Do this
'ComscoreStreamingQuery': 'e1edae8122517d013405f237ffcc124515dc6ded82480a88daef69c83b53ac01',

and

Line 1652

    query = [{
        'operationName': 'StreamMetadata',
        'variables': {'channelLogin': stream_id.lower()}
    }]

Do this

    query = [{
        'operationName': 'StreamMetadata',
        'variables': {'channelLogin': stream_id.lower()}
    },{
        'operationName': 'ComscoreStreamingQuery',
        'variables': {
            'channel': stream_id.lower(),
            'clipSlug': '',
            'isClip': False,
            'isLive': True,
            'isVodOrCollection': False,
            'vodID': '',
    }}]

having the same issue.

Line 1652
[…]
Do this
[…]

Thanks — that seems to fix acquisition from a live stream, but the problem remains for a VOD.

Acting on raw intuition based on the change you suggested for get_chat_by_stream_id I tried amending get_chat_by_vod_id to say:

        query = [{
            'operationName': 'VideoMetadata',
            'variables': {
                'channelLogin': '',
                'videoID': vod_id
            }
        },{
            'operationName': 'ComscoreStreamingQuery',
            'variables': {
                'channel': '',
                'clipSlug': '',
                'isClip': False,
                'isLive': False,
                'isVodOrCollection': False,
                'vodID': vod_id,
            }
        }]

…but that didn't work ­­— when I instrumented it to print the GQL response, it read:

[
    {
        "errors": [
            {
                "message": "PersistedQueryNotFound"
            }
        ],
        "extensions": {
            "durationMilliseconds": 2,
            "operationName": "VideoMetadata",
            "requestID": "01K9S9E7XR72CQVP8SRYBJ647D"
        }
    },
    {
        "data": {},
        "extensions": {
            "durationMilliseconds": 2,
            "operationName": "ComscoreStreamingQuery",
            "requestID": "01K9S9E7XR72CQVP8SRYBJ647D"
        }
    }

Same issue here. Did anything change in the Twitch API?

I don't see anything in the changelog at https://dev.twitch.tv/docs/change-log/

@uwu-crj @sebastientromp

I changed the hash values ​​of StreamMetadata and VideoMetadata as follows and it worked fine.
The relevant code is around line 842.

_OPERATION_HASHES = {
        'StreamMetadata': 'b57f9b910f8cd1a4659d894fe7550ccc81ec9052c01e438b290fd66a040b9b93',
        ...
        'VideoMetadata': '45111672eea2e507f8ba44d101a61862f9c56b11dee09a15634cb75cb9b9084d',
        ...
}

@nio-p

I changed the hash values ​​of StreamMetadata and VideoMetadata as follows and it worked fine. The relevant code is around line 842.

Excellent. Thanks!

That gets downloading chat for VODs working, but… did you test it on a live stream? I find it doesn't help there.

I think everything may work if I mash together your solution and @babupipi 's, though. 🤞

Update: Yes. A frankenpatch works for both live streams and VODs. (I've not tested it on clips…)

843a844
>         
848c849
<         'VideoMetadata': '226edb3e692509f727fd56821f5653c05740242c82b0388883e0c0e75dcbf687',
---
>         'VideoMetadata': '45111672eea2e507f8ba44d101a61862f9c56b11dee09a15634cb75cb9b9084d',
852a854,855
>         'ComscoreStreamingQuery': 'e1edae8122517d013405f237ffcc124515dc6ded82480a88daef69c83b53ac01',
>         
856d858
<         # 'ComscoreStreamingQuery': 'e1edae8122517d013405f237ffcc124515dc6ded82480a88daef69c83b53ac01',
1654a1657,1666
>         },{
>             'operationName': 'ComscoreStreamingQuery',
>             'variables': {
>                 'channel': stream_id.lower(),
>                 'clipSlug': '',
>                 'isClip': False,
>                 'isLive': True,
>                 'isVodOrCollection': False,
>                 'vodID': '',
>             }

should I expect a new version soon?

should I expect a new version soon?

Personally I won't count on that, the the last update this lib received was in 2023. Thank you all for the patchwork solution tough.

Hi all,

By inspecting the network requests in Twitch, I found that most of these hashes have changed and, the live collecting one has also changed the required request variables.

Here should be the updated ones i found for _OPERATION_HASHES around line 842

    'ChatList_Badges': '838a7e0b47c09cac05f93ff081a9ff4f876b68f7624f0fc465fe30031e372fc2',
    'StreamMetadata': 'b57f9b910f8cd1a4659d894fe7550ccc81ec9052c01e438b290fd66a040b9b93',
    'BrowsePage_Popular': 'fb60a7f9b2fe8f9c9a080f41585bd4564bea9d3030f4d7cb8ab7f9e99b1cee67',
    'ChannelVideoShelvesQuery': 'a30af24ef449ab2e9be4a9c187ef14d294e4ec3041420d219b4c60fc9de7f27c',
    'ClipsCards__User': '90c33f5e6465122fba8f9371e2a97076f9ed06c6fed3788d002ab9eba8f91d88',
    'VideoMetadata': '45111672eea2e507f8ba44d101a61862f9c56b11dee09a15634cb75cb9b9084d',
    'FilterableVideoTower_Videos': '67004f7881e65c297936f32c75246470629557a393788fb5a69d6d9a25a8fd5f',
    'VideoCommentsByOffsetOrCursor': 'b70a3591ff0f4e0313d126c6a1502d79a1c02baebb288227c582044aa76adf6a',

For the live collecting it now seems for the query to require the variables to include "includeIsDJ": true.

Around line 1653 in twitch.py change it to this:

    query = [{
        'operationName': 'StreamMetadata',
        'variables': {
            'channelLogin': stream_id.lower(),
            'includeIsDJ': True
        }
    }]

After applying these changes, my live and VOD/clip collection are both working again.

Hope this helps!

should I expect a new version soon?

I published a new version (which is this repo's master + the changes suggested above) to sebastientromp-chat-downloader if you don't want to bother with creating a new version yourself and only need this update

I published a new version (which is this repo's master + the changes suggested above) to sebastientromp-chat-downloader if you don't want to bother with creating a new version yourself and only need this update

A neat idea. Unfortunately, your patch somehow seems to have lost badge metadata for both VODs and live broadcasts.

should I expect a new version soon?

I published a new version (which is this repo's master + the changes suggested above) to sebastientromp-chat-downloader if you don't want to bother with creating a new version yourself and only need this update

what does it means? how can I get the latest changes?

@gadi-playstream-gg

Hello,

what does it means? how can I get the latest changes?

@sebastientromp has forked and released a new package.
The package name is "sebastientromp-chat-downloader."
For more information, see the repository below:
https://github.com/sebastientromp/chat-downloader

Furthermore, the original package has not been maintained since 2023.
Therefore, you will need to fork and maintain it yourself, use a volunteer-modified version (such as sebastientromp-chat-downloader.), or use a different package (e.g., https://github.com/lay295/TwitchDownloader).

I published a new version (which is this repo's master + the changes suggested above) to sebastientromp-chat-downloader if you don't want to bother with creating a new version yourself and only need this update

A neat idea. Unfortunately, your patch somehow seems to have lost badge metadata for both VODs and live broadcasts.

The metadata for global and channel-specific badges are now retrived by two separate operations, so you would need:

--- a/chat_downloader/sites/twitch.py
+++ b/chat_downloader/sites/twitch.py
@@ -788,7 +788,11 @@ def _update_badge_info(self, channel):
                 'channelLogin': channel
             }
         }]
+        gquery = [{
+            'operationName': 'GlobalBadges',
+        }]
         data = multi_get(self._download_gql(query), 0, 'data') or {}
+        data.update(multi_get(self._download_gql(gquery), 0, 'data') or {})
 
         badges = data.get('badges') or []
         user = multi_get(data, 'user', 'broadcastBadges') or []
@@ -840,7 +844,8 @@ def _parse_item(item, offset, channel_id=None):
         return info
 
     _OPERATION_HASHES = {
         'ChatList_Badges': '838a7e0b47c09cac05f93ff081a9ff4f876b68f7624f0fc465fe30031e372fc2',
+        'GlobalBadges': '9db27e18d61ee393ccfdec8c7d90f14f9a11266298c2e5eb808550b77d7bcdf6',
         'StreamMetadata': 'b57f9b910f8cd1a4659d894fe7550ccc81ec9052c01e438b290fd66a040b9b93',
         'BrowsePage_Popular': 'fb60a7f9b2fe8f9c9a080f41585bd4564bea9d3030f4d7cb8ab7f9e99b1cee67',
         'ChannelVideoShelvesQuery': 'a30af24ef449ab2e9be4a9c187ef14d294e4ec3041420d219b4c60fc9de7f27c',

@sebastientromp you may want to include that in your fork