pedrosaclout
/
scrape_about_more_peers_mastodon
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

stable

Browse Source
master
Pedro Sá Couto 6 years ago
parent a73da10cb0
commit 355a5a2d97
3 changed files with 131 additions and 6 deletions
Show Stats Download Patch File Download Diff File

BIN
.DS_Store vendored
View File

Binary file not shown.

125
geckodriver.log
Unescape Escape View File

@ -4546,3 +4546,128 @@ Exiting due to channel error.
Exiting due to channel error. Exiting due to channel error.
[GFX1-]: Receive IPC close with reason=AbnormalShutdown [GFX1-]: Receive IPC close with reason=AbnormalShutdown
Exiting due to channel error. Exiting due to channel error.
1553277673962 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.zhgevctEE0W3"
1553277674383 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277674383 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277675762 Marionette INFO Listening on port 58132
1553277675819 Marionette WARN TLS certificate errors will be ignored for this session
1553277688129 Marionette INFO Stopped listening on port 58132
1553277690033 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.QaAncuvriFzK"
1553277690432 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277690432 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277691808 Marionette INFO Listening on port 58243
1553277691890 Marionette WARN TLS certificate errors will be ignored for this session
1553277701698 Marionette INFO Stopped listening on port 58243
1553277703647 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.dtwywZFiKNOG"
1553277704048 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277704048 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277705414 Marionette INFO Listening on port 58345
1553277705495 Marionette WARN TLS certificate errors will be ignored for this session
1553277715566 Marionette INFO Stopped listening on port 58345
1553277717514 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.pOjI08X2ZVby"
1553277717916 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277717916 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277719297 Marionette INFO Listening on port 58457
1553277719364 Marionette WARN TLS certificate errors will be ignored for this session
1553277728929 Marionette INFO Stopped listening on port 58457
1553277730885 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.6JnpAZ72h3jh"
1553277731279 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277731279 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277732650 Marionette INFO Listening on port 58549
1553277732762 Marionette WARN TLS certificate errors will be ignored for this session
1553277744405 Marionette INFO Stopped listening on port 58549
1553277746337 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.xGUWOp1kp5qT"
1553277746736 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277746736 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277748118 Marionette INFO Listening on port 58654
1553277748190 Marionette WARN TLS certificate errors will be ignored for this session
1553277759345 Marionette INFO Stopped listening on port 58654
1553277761285 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.e3LgbN3yHAzs"
1553277761693 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277761694 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277763069 Marionette INFO Listening on port 58752
1553277763130 Marionette WARN TLS certificate errors will be ignored for this session
1553277767790 Marionette INFO Stopped listening on port 58752
1553277769715 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.OPSt6bMzNtC1"
1553277770111 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553277770111 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553277771489 Marionette INFO Listening on port 58830
1553277771562 Marionette WARN TLS certificate errors will be ignored for this session
console.error: BroadcastService:
receivedBroadcastMessage: handler for
remote-settings/monitor_changes
threw error:
Message: Error: Polling for changes failed: NetworkError when attempting to fetch resource..
Stack:
remoteSettingsFunction/remoteSettings.pollChanges@resource://services-settings/remote-settings.js:188:13
Can't find symbol 'GetGraphicsResetStatus'.
1553283859271 Marionette INFO Stopped listening on port 58830
1553363229647 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.bpqXaFfTeSki"
1553363230211 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363230211 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553363231695 Marionette INFO Listening on port 51150
1553363231795 Marionette WARN TLS certificate errors will be ignored for this session
1553363242572 Marionette INFO Stopped listening on port 51150
1553363244627 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.5xI3VZDZzA9E"
1553363245040 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363245040 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553363246465 Marionette INFO Listening on port 51198
1553363246564 Marionette WARN TLS certificate errors will be ignored for this session
1553363256184 Marionette INFO Stopped listening on port 51198
1553363258152 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.HO0cGsUYZ3v3"
1553363258554 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363258554 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553363259953 Marionette INFO Listening on port 51251
1553363259995 Marionette WARN TLS certificate errors will be ignored for this session
1553363275572 Marionette INFO Stopped listening on port 51251
1553363277511 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.qHPkM3QQVhnA"
1553363278007 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363278007 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Exiting due to channel error.
1553363315778 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.4S74PU19amKh"
1553363316195 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363316195 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553363317624 Marionette INFO Listening on port 51333
1553363317711 Marionette WARN TLS certificate errors will be ignored for this session
1553363328586 Marionette INFO Stopped listening on port 51333
1553363330531 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.qfawahnG53Pp"
1553363331011 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363331011 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553363332427 Marionette INFO Listening on port 51379
1553363332471 Marionette WARN TLS certificate errors will be ignored for this session
1553363342158 Marionette INFO Stopped listening on port 51379
1553363344111 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.kJ31CtDDmI75"
1553363344513 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363344513 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553363345909 Marionette INFO Listening on port 51425
1553363345958 Marionette WARN TLS certificate errors will be ignored for this session
1553363355648 Marionette INFO Stopped listening on port 51425
1553363357596 mozrunner::runner INFO Running command: "/Applications/Firefox.app/Contents/MacOS/firefox-bin" "-marionette" "-foreground" "-no-remote" "-profile" "/var/folders/bc/txjl5mmd7cb1ngc8vvs687sc0000gn/T/rust_mozprofile.aflrYO2IL9hG"
1553363358088 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: resource://pdf.js/
1553363358089 addons.webextension.screenshots@mozilla.org WARN Loading extension 'screenshots@mozilla.org': Reading manifest: Invalid host permission: about:reader*
Can't find symbol 'GetGraphicsResetStatus'.
1553363359498 Marionette INFO Listening on port 51474
1553363359534 Marionette WARN TLS certificate errors will be ignored for this session
[GFX1-]: Receive IPC close with reason=AbnormalShutdown
[Child 21849, Chrome_ChildThread] WARNING: pipe error: Broken pipe: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 718
Exiting due to channel error.
[GFX1-]: Receive IPC close with reason=AbnormalShutdown
Exiting due to channel error.
[GFX1-]: Receive IPC close with reason=AbnormalShutdown
[Child 21847, Chrome_ChildThread] WARNING: pipe error: Broken pipe: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 718
Exiting due to channel error.

12
peer_about_more.py
Unescape Escape View File

@ -41,10 +41,10 @@ for n, peer in enumerate(peers):
text_file.write("Instance:"+"\n"+(peer)+"\n") text_file.write("Instance:"+"\n"+(peer)+"\n")
try: try:
about = driver.find_element_by_css_selector('.rich-formatting') about_more = driver.find_element_by_css_selector('.rich-formatting')
print ('About:') print ('About more:')
print(about.text) print(about_more.text)
text_file.write("About:"+"\n"+about.text+"\n"+"\n") text_file.write("About more:"+"\n"+about_more.text+"\n"+"\n")
time.sleep(1) time.sleep(1)
try: try:
@ -64,8 +64,8 @@ for n, peer in enumerate(peers):
time.sleep(0.5) time.sleep(0.5)
except: except:
text_file.write("Impossible to check instance"+"\n"+"\n") text_file.write("No about more"+"\n"+"\n")
print("Status:"+"\n"+"Impossible to check instance") print("Status:"+"\n"+"No about more")
time.sleep(1) time.sleep(1)
# close new tab # close new tab

Write Preview
Loading…
Cancel
Save