美丽的汤不等到页面完全加载
问题内容：
因此，在下面的代码中，我想打开一个公寓网站的网址并抓取该网页。唯一的问题是，Beautiful
Soup不会等到整个网页都呈现出来。直到将它们加载到页面上之前，这些公寓才会在html中呈现，这需要几秒钟的时间。我该如何解决？
from urllib.request import urlopen as uReq
from bs4 import BeautifulSoup as soup
my_url = 'https://xxxxx.com/properties/?sort=latest'
uClient = uReq(my_url)
page_html = uClient.read()
uClient.close()
page_soup = soup(page_html, "html.parser")
containers = page_soup.findAll("div",{"class":"grid-item"})
#len(containers) is empty since the contents haven't been loaded yet!
问题答案：
如果要等待页面完全加载其数据，则应考虑使用硒，在您的情况下，它可能看起来像这样：
from bs4 import BeautifulSoup
from selenium.webdriver import Chrome
from selenium.webdriver.chrome.options import Options
url = "<URL>"
chrome_options = Options()
chrome_options.add_argument("--headless") # Opens the browser up in background
with Chrome(options=chrome_options) as browser:
browser.get(url)
html = browser.page_source
page_soup = BeautifulSoup(html, 'html.parser')
containers = page_soup.findAll("div",{"class":"grid-item"})
