RNN 学习笔记

NLP (Natural Language Processing)

Tensorflow-reader.py

os.path.join(data_path, "ptb.train.txt")
#定义文件路径

#join函数为路径拼接函数
>>>os.path.join('a','b','c')
>>>a\\b\\c'

_build_vocab(train_path)
#对输入文本进行排序,首要字段 value(频率),次要字段 key,返回类型为字典(字符:_id)

train_data = _file_to_word_ids(train_path, word_to_id)
#将输入文本按照生成的字典映射为 id 序列

vocabulary = len(word_to_id)
#记录字典大小,未在字典中出现的字符将被忽略

with tf.name_scope(name, "PTBProducer", [raw_data, batch_size, num_steps]):
#定义命名空间,不同命名空间内的 Variable name 属性可以相同

__init__(
    name,#域名
    default_name=None,#域名未指定时的默认值
    values=None#传入的变量列表,可在上下文中操作修改
)

raw_data = tf.convert_to_tensor(raw_data, name="raw_data", dtype=tf.int32)
#将 python 中的数据类型转换为 tensor 张量

batch_size = tf.size(raw_data)
#同一时间输入的数据量,为了充分利用 GPU 并行计算能力

data = tf.reshape(raw_data[0 : batch_size * batch_len,[batch_size, batch_len])

>>> a = ([2,2],[3,3])
([2, 2], [3, 3])
>>> b=numpy.reshape(b,(2,-1))#可以自动推断-1的值,至多出现一次
array([[2, 2],
       [3, 3]])
>>> b[0:1]#表示输出b[0]和b[1]
array([[2, 2]])
batch_len = data_len // batch_size
# 这里的data指所有训练样例
data = tf.reshape(raw_data[0 : batch_size * batch_len],
                      [batch_size, batch_len])
# TF仅支持定长输入,这里设定RNN网络的序列长度为num_steps,即 A 的数量
epoch_size = (batch_len - 1) // num_steps 
#batch_size 指每个每个 batch 中有多少 sentence 即行数
#num_steps 指样本序列长度,即输入字符次数,为 bathc 的列数
#epoch_size 指在一个周期内需要迭代多少 batch

i = tf.train.range_input_producer(NUM_EXPOCHES, num_epochs=1, shuffle=False).dequeue()

NUM_EXPOCHES 表示返回的 list 中只会出现 0..NUM_EXPOCHES-1,num_epochs 表示循环次数

NUM_EXPOCHES = 3 num_epochs = 2 输出为 0,1,2,0,1,2 若不指定 num_epochs 则可以产生无限的 batch

x = tf.slice(data, [0, i * num_steps], [batch_size, num_steps])
y = tf.slice(data, [0, i * num_steps + 1], [batch_size, num_steps])

silce 传入起始位置,和裁剪长度

[0,inum_steps]表示从第一行,第 inum_steps-1 个开始截取
前面已经将 data reshape 行数即为 batch_size

>>> x
[[1, 2, 3], [4, 5, 6]]
>>> out=tf.slice(x,[0,1],[2,1])
#只能切出矩形tf.slice(x,[0,1],[2,3]) error:3列超出范围
>>> sess.run(out)
array([[2],
       [5]], dtype=int32)

当tf.get_variable_scope().reuse == False,调用该函数会创建新的变量
当tf.get_variable_scope().reuse == True,调用该函数会重用已经创建的变量

with tf.variable_scope("foo"):
      v = tf.get_variable("v", [1])
with tf.variable_scope("foo", reuse=True):
      v1 = tf.get_variable("v", [1])
assert v1 is v

Q&A

cell 中隐藏层神经元个数
激活函数的输入向量的维度

state=sess.run(model.initial_state)得到的state就是全0的初始状态,每次迭代的时候feed_dict中的state都是0
第一次迭代初始状态是0,迭代完成后会得到新的状态(这里的新状态不再是0),在第二次迭代时,就以这个新的状态作为初始状态,第三次迭代就以第二次迭代完成的新状态作为初始状态,以此类推

Embedding层有什么用
使用One-hot 方法编码的向量会很高维也很稀疏。假设我们在做自然语言处理(NLP)中遇到了一个包含2000个词的字典,当时用One-hot编码时,每一个词会被一个包含2000个整数的向量来表示,其中1999个数字是0,要是我的字典再大一点的话这种方法的计算效率岂不是大打折扣?
训练神经网络的过程中,每个嵌入的向量都会得到更新。如果你看到了博客上面的图片你就会发现在多维空间中词与词之间有多少相似性,这使我们能可视化的了解词语之间的关系,不仅仅是词语,任何能通过嵌入层 Embedding 转换成向量的内容都可以这样做。

tf.nn.rnn_cell.DrououtWrapper(cell, input_keep_prob=1.0, output_keep_prob=1.0)第一个就是输入的循环神经网络的 cell,可以设定为BasicLSTMCell等等。第二个参数就是输入数据使用 dropout,1时不执行dropout。第三个参数为输出层的 dropout,输出,不同的循环层之间使用,或者全连接层,不会在同一层的循环体中使用。

cells = [tf.nn.rnn_cell.DropoutWrapper(cell, output_keep_prob=1.0-self.dropout) for cell in cells]

tf.nn.rnn_cell.MultiRNNCell([list RNNcell], state_is_tuple=True).这个函数里面主要这两个参数,第一个参数就是输入的RNN实例形成的列表,第二个参数就是让状态是一个元组,官方推荐就是用True。

 multi_cell = tf.nn.rnn_cell.MultiRNNCell(cells)

Softmax函数
Softmax函数,或称归一化指数函数,是逻辑函数的一种推广。它能将一个含任意实数的K维向量 “压缩”到另一个K维实向量 中,使得每一个元素的范围都在 之间,并且所有元素的和为1。

tf.concat是连接两个矩阵的操作
tf.concat(concat_dim, values, name=’concat’)
第一个参数concat_dim:连接维度,concat_dim 是 0,那么在某一个shape的第一个维度上连,对应到实际,就是叠放到列上
可以这么理解:在维度 0 上将 shape 为(2,2)的两个张量 concat 结果为 shape 为(4,2)的张量
values 是一个 tensor 的 list 或者 tuple。

t1 = [[1, 2, 3], [4, 5, 6]]
t2 = [[7, 8, 9], [10, 11, 12]]
tf.concat(0, [t1, t2]) == > [[1, 2, 3], [4, 5, 6], [7, 8, 9], [10, 11, 12]]

RNN 学习笔记》有3,190个想法

  1. MatBuct说:

    Dove Acquistare Cialis In Italia Achat Kamagra Securise [url=http://cialibuy.com]Buy Cialis[/url] Which Bacteria Does Cephalexin Treat Amoxil Otic Medicinale Levitra

  2. MatBuct说:

    Generico Cialis Safe Place To Buy Priligy Viagra Sicher Online Bestellen [url=http://cialibuy.com]generic cialis from india[/url] Purchase isotretinoin pills next day pharmacy amex Priligy Madrid

  3. Awamoub说:

    Success comes from failure essay short essay on liberty, expository essay on how to cook jollof rice essay sat format, university of chicago admission essay.
    buy a paper Whether your professor assigned a research paper, term paper, book report, essays, thesis papers, literature reviews or any other academic or non-academic writing tasks, knows exactly how to help you and how to make your essay be perfect.

  4. elosuh说:

    The bonus codes must then be entered when making a deposit, although it must be within the timeframe stated and there will be certain terms and conditions that need to be met to take advantage of each offer.
    casinospel These techniques, however, are impossible to apply in virtual games of blackjack, largely due to the fact the cards in the shoe or deck are reshuffled automatically after each hand.

  5. Nitomia说:

    Within academia, plagiarism by students, professors, or researchers is considered academic dishonesty or academic fraud, and offenders are subject to academic censure, up to and including expulsion. paper writing service On the other hand, if the testimonials and best online essay writing services reviews are negative, for example, the complaints about prices, customer service, or the quality of the work, you can reject the website and look for other options.

  6. Jamslulk说:

    After these three modules you can decide yourself if you want to continue the other 4 modules of the course, and can enroll in a later version of the complete course. write my paper for me The process of writing a research paper should comprise of investigating the evidence base to retrieve relevant research papers and accordingly based on the findings an appropriate methodology should be chosen to address the research topic.

  7. theanof说:

    Essayist day crossword sthree sakthi karanam essay in malayalam language, essay writing about lying, vidyarthi jeevan par essay in hindi, essay dr rajendra prasad hindi language. custom paper Fill in the type of paper you need, the topic or question to be handled, formatting rules that have to be followed, the volume of the work, and the deadline for delivery.

  8. adosern说:

    Factory, we make ordering custom coffee cups and soup containers simple, affordable and hassle-free for everyone — wholesale buyers, small business owners, wedding planners and special event organizers. write my paper for me It is necessary to provide background and analysis of the legal problem in a body paragraph to adequately analyze background and analysis of the legal question.

  9. payday说:

    Verlusts, als solche zu identifizieren, sie aufzuschreiben und zu versuchen, sie neutral oder gar positiv wiederzugeben. authorecourses Wir sehen uns nicht mehr so oft, was auch nicht mehr machbar ist, aber wir telefonieren oder schreiben uns noch sehr oft.

  10. Duathy说:

    The number of deaths in the recent weeks should be interpreted with caution as adjustments for delayed registrations may be imprecise. keto success academy Herzens konzentrierst, gibt es niemanden, der konzentrierter, entschlossener und unerbittlicher ist als du.

  11. basmata说:

    Studies show that unplugging from technology boosts your brainpower, improves feelings of happiness and peacefulness, and creates more free time for yourself. tgu-tommyguns Reportazh s asfaltalimited in motion, but, freed of the need to redraw the same figure thousands of times, animators were able to attain detailed and expressive graphics of extraordinary quality.

  12. Duernjep说:

    Heap bioleaching is a very slow process that can take up to several years to achieve good metal recoveries. thunkzine This is not a popular truth to speak out loud on reddit, but the fact is, the purchasing of sex is basically a malephenomenon.

  13. aredaby说:

    Agents who act on behalf of a third party are jointly and separately liable for the fulfillment of contract on behalf of their principals. indiathebook Conclusivethey could seaplane or ophthalmia and mamans best exlover with ninetyfour years lethality of poe.

  14. EyeJaild说:

    [url=http://clementmaotakacs.com/in-our-offline-promoting-methods/]hydroxychloroquine over the counter[/url] [url=http://www.tiantuo.net/inc/gosite.asp?id=198&url=https://chloroquine24.com/]buy hydroxychloroquine online[/url] [url=https://clicks.fanbridge.com/l.php?cid=1051406&sid=176308641&url=https%3A%2F%2Fwww.chloroquine24.com%2Findex.html]hydroxychloroquine over the counter[/url] [url=http://admin.designguide.com/redirect.ashx?url=http://www.chloroquine24.com/index.html]chloroquine for sale[/url] [url=http://www.vinex-media.ru/redirect.php?url=https://chloroquine24.com/index.html]hydroxychloroquine for sale[/url] [url=http://www.science.ph/inc/click.php?url=http://www.chloroquine24.com/index.html]purchase hydroxychloroquine[/url] [url=http://mod.ceskyinternet.cz/statHandler/redirect.php?item=5007961&service=20&server=18&region=5&firm=5007961&url=https://www.chloroquine24.com/]buy hydroxychloroquine[/url] [url=https://www.terre-net-media.fr/ApiMkt/Redirect?link=http://chloroquine24.com/index.html]chloroquine[/url] [url=http://www.brbpublications.com/gen/PrrnAdClick.aspx?Id=3040&Loc=7&url=https://chloroquine24.com/index.html]buy hydroxychloroquine[/url] [url=http://top.bigmir.net/goto.php?url=https://www.chloroquine24.com/]hydroxychloroquine for sale[/url] [url=http://www.netday.org/directory/XcDirRedirect.asp?ID=220&url=http://www.chloroquine24.com/]chloroquine online[/url] [url=https://tracker2.ad5track.com/tracker/click?i=58bec957eec3dfb1f81e3d8b&o=58bdd34beec3dfb1f8d4f31d&redirect_url=http://chloroquine24.com/index.html]purchase hydroxychloroquine[/url] [url=http://www.ivis.org/calredir.asp?ID=13062&url=https://chloroquine24.com/]buy hydroxychloroquine[/url] [url=http://www.ensp.fiocruz.br/portal-ensp/noticia/counter.php?content=link&contentid=3177&link=https://chloroquine24.com/index.html]chloroquine over the counter[/url] [url=http://affiliates.bookdepository.com/scripts/click.php?a_aid=nickijmarkus&a_bid=5be39ef5&desturl=http%3A%2F%2Fwww.chloroquine24.com%2F]hydroxychloroquine over the counter[/url] [url=http://m.shopinchicago.com/redirect.aspx?url=http://chloroquine24.com/index.html]hydroxychloroquine for sale[/url] [url=https://www.huizen-holland.nl/redirect.php?id=1245&link=https://www.chloroquine24.com/index.html]chloroquine[/url] [url=http://forum.artcontact.org/go.php?http://www.chloroquine24.com/index.html%5Dbuy chloroquine[/url] [url=http://www.solutionsrealtynow.com/searchpoint/redir.asp?reg_id=ptypes&sname=/searchpoint/search.asp&lid=1&sponsor=lea&url=http://www.chloroquine24.com/index.html]chloroquine for sale[/url] [url=http://toplink.miliweb.net/out-16961.php?web=http://www.chloroquine24.com/]hydroxychloroquine over the counter[/url]

  15. AlanJaild说:

    [url=https://atarax1.com/]atarax[/url] [url=https://estrace2.com/]estrace tablets[/url] [url=https://stromectolav.com/]buy ivermectin uk[/url] [url=https://advair911.com/]advair diskus 500[/url] [url=https://doxycyclinesr.com/]doxycycline cream[/url] [url=https://tretinoin05.com/]tretinoin[/url] [url=https://propecia3.com/]propecia[/url] [url=https://erythromycinlab.com/]erythromycin 500[/url] [url=https://baclofenmed.com/]baclofen 10mg[/url] [url=https://acyclovir24.com/]acyclovir 400 mg[/url] [url=https://cipro24.com/]cipro 500 mg[/url] [url=https://abilifyrx.com/]generic abilify canada[/url] [url=https://doxycycline911.com/]where to buy doxycycline[/url] [url=https://sildenafilvia.com/]cheap sildenafil[/url] [url=https://strattera25.com/]strattera[/url] [url=https://bupropionxr.com/]bupropion 75 mg[/url] [url=https://bactrin.com/]bactrim pills[/url] [url=https://allopurinol24.com/]where to buy allopurinol tablets[/url] [url=https://prednisolone365.com/]prednisolone uk[/url] [url=https://sildenafil30.com/]sildenafil[/url]

  16. PaulJaild说:

    [url=https://baclofenmed.com/]baclofen cost 10mg[/url] [url=https://trazodone24.com/]trazodone prescription uk[/url] [url=https://hydroxychloroquineonline.com/]quineprox 40 mg[/url] [url=https://finpecia24.com/]finpecia 1 mg[/url] [url=https://viagrasoftab.com/]generic viagra soft[/url]

  17. EyeJaild说:

    [url=http://www.wmrok.com/kl.php?n=https%3A%2F%2Fchloroquine24.com%2F]chloroquine for sale[/url] [url=https://beporsam.ir/go/?url=https://www.chloroquine24.com/index.html]chloroquine[/url] [url=http://www.semtex.ru/go.php?a=http://www.chloroquine24.com/]buy chloroquine[/url] [url=http://www.emlaktakibi.com/Home/Go/1093?tabloNo=6&link=https://chloroquine24.com/]hydroxychloroquine[/url] [url=http://graf-avto.ru/order/item.php?url=https://www.chloroquine24.com/index.html]buy hydroxychloroquine online[/url] [url=http://voteme100.com/cgi-bin/toplist/out.cgi?id=ourwives&url=https://chloroquine24.com/]buy chloroquine online[/url] [url=https://www.tuda-suda.by/url.php?to=www.chloroquine24.com%2F]chloroquine over the counter[/url] [url=http://egsosh1.ru/bitrix/rk.php?goto=http://www.chloroquine24.com/]hydroxychloroquine over the counter[/url] [url=https://middeldatabasen.dk/DeepLinker.asp?url=http://www.chloroquine24.com/index.html]chloroquine for sale[/url] [url=http://live.adtrackir1.co.uk/pub/inbound_email/track/click.php?email=sebastian.mille@mjvibe.com&url=http://chloroquine24.com/]buy hydroxychloroquine[/url] [url=http://www.risn.ru/jump.php?url=https://chloroquine24.com/]hydroxychloroquine for sale[/url] [url=https://psihologion.ru/redirect?url=http://chloroquine24.com/]purchase hydroxychloroquine[/url] [url=http://m.shopindenver.com/redirect.aspx?url=http://chloroquine24.com/index.html]chloroquine[/url] [url=https://ggmania.com/link.php3?rid=29986539&url=https://www.chloroquine24.com/index.html]hydroxychloroquine over the counter[/url] [url=http://www.crazythumbs.org/tgp/click.php?id=51366&u=https://www.chloroquine24.com/]purchase hydroxychloroquine[/url] [url=http://hv-service.ru/bitrix/redirect.php?event1=&event2=&event3=&goto=http://www.chloroquine24.com/index.html]hydroxychloroquine over the counter[/url] [url=http://www.beachwoodreporter.com/adserver/adclick.php?bannerid=20&zoneid=0&source=&dest=https://www.chloroquine24.com/index.html]hydroxychloroquine for sale[/url] [url=http://www.hortamuseum.be/modules/babel/redirect.php?newlang=jp&newurl=https://www.chloroquine24.com/]hydroxychloroquine for sale[/url] [url=http://mppodarki.ru/bitrix/rk.php?goto=https://www.chloroquine24.com/index.html]chloroquine for sale[/url] [url=http://www.jan-jan.net/search/rank.php?mode=link&id=913&url=https%3A%2F%2Fwww.chloroquine24.com%2F]hydroxychloroquine for sale[/url]

  18. JasonJaild说:

    [url=http://abilifyrx.com/]abilify 10[/url] [url=http://stromectolmed.com/]ivermectin malaria[/url] [url=http://retina05.com/]where to buy retin-a[/url] [url=http://albuterol360.com/]can i buy albuterol in mexico[/url] [url=http://synthroidth.com/]cost of synthroid 100mcg[/url] [url=http://finpecia24.com/]finpecia 1 mg[/url] [url=http://tadalafil3.com/]tadalafil tablets 20mg[/url] [url=http://sildenafilvia.com/]sildenafil tablets 100mg[/url] [url=http://robaxin24.com/]buy robaxin[/url] [url=http://cephalexin1.com/]cephalexin[/url]

  19. IvyJaild说:

    [url=https://ivermectinotc.com/]can you buy stromectol over the counter[/url] [url=https://viagrasoftab.com/]viagra soft gel capsules[/url] [url=https://ivermectin3.com/]ivermectin 0.2mg[/url] [url=https://stromectolsale.com/]ivermectin for sale[/url] [url=https://hydroxychloroquine911.com/]hydroxychloroquine buy[/url] [url=https://hydroxychloroquineplaq.com/]plaquenil malaria[/url] [url=https://neurontin2.com/]buy generic neurontin[/url] [url=https://hydroxychloroquineonline.com/]plaquenil for psoriatic arthritis[/url] [url=https://stromectolpill.com/]stromectol tablets[/url] [url=https://ivermectinvir.com/]stromectol ivermectin[/url] [url=https://atarax1.com/]atarax[/url] [url=https://propecia911.com/]cheapest online propecia[/url] [url=https://doxycyclinesr.com/]doxycycline hyclate 100mg[/url] [url=https://prednisolone365.com/]prednisolone 1[/url] [url=https://cipro750.com/]cipro[/url] [url=https://clomidtab.com/]clomid 50mg[/url] [url=https://hydroxychloroquinelab.com/]buy hydroxychloroquine[/url] [url=https://lexxapro.com/]lexapro[/url] [url=https://cialis4.com/]canada pharmacy cialis[/url] [url=https://vardenafll.com/]buy vardenafil[/url]

  20. CarlJaild说:

    [url=https://glucophaqe.com/]buy glucophage[/url] [url=https://bupropionxr.com/]bupropion generic cost[/url] [url=https://tamoxifen24.com/]tamoxifen price in india[/url] [url=https://ivermectinotc.com/]stromectol tablets[/url] [url=https://clonidine911.com/]clonidine 0.1[/url]

  21. DenJaild说:

    [url=http://prednisonecort.com/]prednisone medication[/url] [url=http://trazodone24.com/]trazodone 4 mg[/url] [url=http://colchicine100.com/]colchicine 0.6[/url] [url=http://cleocincr.com/]buy cleocin gel[/url] [url=http://sildenafil30.com/]20 mg sildenafil 689[/url]

  22. MiaJaild说:

    [url=https://viagra2019.com/]online viagra pills[/url] [url=https://albuterol360.com/]albuterol tablets over the counter[/url] [url=https://baclofenmed.com/]baclofen 10mg tablets[/url] [url=https://hydroxychloroquineonline.com/]plaquenil price australia[/url] [url=https://ivermectinbuy.com/]stromectol coronavirus[/url]

  23. AlanJaild说:

    [url=https://stromectolsale.com/]ivermectin for sale[/url] [url=https://bupropionxr.com/]bupropion price in india[/url] [url=https://stromectolivermectin.com/]generic ivermectin[/url] [url=https://cephalexin1.com/]buy cephalexin 250 mg[/url] [url=https://estrace2.com/]estrace tablets[/url] [url=https://sildenafilvia.com/]sildenafil tablets[/url] [url=https://stromectolmed.com/]stromectol medication[/url] [url=https://strattera25.com/]atomoxetine price[/url] [url=https://allopurinol24.com/]allopurinol 2084[/url] [url=https://tretinoin05.com/]non prescription tretinoin[/url] [url=https://ivermectinstromectol.com/]ivermectin stromectol[/url] [url=https://advair911.com/]advair over the counter[/url] [url=https://femalesviagra.com/]female version of viagra[/url] [url=https://arimidex365.com/]arimidex depression[/url] [url=https://ivermectin24.com/]ivermectin stromectol[/url] [url=https://paxil365.com/]paxil generic[/url] [url=https://albuterol2020.com/]albuterol aerosol[/url] [url=https://cleocincr.com/]cleocin 300 mg[/url] [url=https://amoxiciline.com/]where can i buy amoxicillin over the counter uk[/url] [url=https://trazodone1.com/]buy trazadone non generic on line without a prescription[/url]

  24. smore traiolit说:

    Attractive section of content. I just stumbled upon your web site and in accession capital to assert that I get in fact enjoyed account your blog posts. Anyway I’ll be subscribing to your feeds and even I achievement you access consistently fast.

  25. CarlJaild说:

    [url=https://ivermectinbuy.com/]ivermectin lotion 0.5[/url] [url=https://finasteridesale.com/]finasteride prescription[/url] [url=https://trazodone1.com/]buy trazodone[/url] [url=https://abilifyrx.com/]buy abilify[/url] [url=https://hydroxychloroquinelab.com/]hydroxychloroquine 0.5 mg[/url]

  26. IvyJaild说:

    [url=https://stromectolsale.com/]ivermectin usa price[/url] [url=https://tamoxifen24.com/]tamoxifen for sale[/url] [url=https://propecia911.com/]buy propecia online[/url] [url=https://retina05.com/]generic retin a[/url] [url=https://erythromycinlab.com/]erythromycin online pharmacy[/url] [url=https://colchicine100.com/]colchicine 0.6 mg[/url] [url=https://ivermectinotc.com/]can you buy stromectol over the counter[/url] [url=https://trazodone1.com/]trazodone[/url] [url=https://levitra2.com/]levitra 10mg[/url] [url=https://zithromax100.com/]buy zithromax[/url] [url=https://ivermectinvir.com/]price of ivermectin[/url] [url=https://tretinoin05.com/]tretinoin prices[/url] [url=https://tadalafiltab.com/]tadalafil 5mg[/url] [url=https://clomidtab.com/]clomid 25mg[/url] [url=https://medrolpack.com/]medrol sale[/url] [url=https://albuterol2020.com/]albuterol sulfate[/url] [url=https://trazodone24.com/]trazodone 150mg[/url] [url=https://baclofenmed.com/]buy baclofen[/url] [url=https://albuterol360.com/]albuterol hfa[/url] [url=https://stromectolav.com/]ivermectin humans[/url]

  27. DenJaild说:

    [url=http://cephalexina.com/]cephalexin 500 mg cost[/url] [url=http://prednisolone365.com/]prednisolone sodium[/url] [url=http://stromectolav.com/]ivermectin gel[/url] [url=http://robaxin24.com/]robaxin online[/url] [url=http://ivermectinbuy.com/]ivermectin cost[/url]

  28. JudyJaild说:

    [url=https://stromectolmed.com/]ivermectin 3[/url] [url=https://erythromycinlab.com/]buy erythromycin tablets 500mg[/url] [url=https://zithromax100.com/]zithromax[/url] [url=https://ivermectin24.com/]ivermectin buy nz[/url] [url=https://stromectolotc.com/]ivermectin 6 tablet[/url] [url=https://albuterol360.com/]buy albuterol canada[/url] [url=https://finpecia24.com/]finpecia 1 mg[/url] [url=https://stromectol24.com/]stromectol tablets[/url] [url=https://diclofenacv.com/]compare diclofenac cream[/url] [url=https://colchicine100.com/]colchicine cost online[/url]

  29. MaryJaild说:

    [url=https://ivermectintab.com/]stromectol tablets[/url] [url=https://stromectolav.com/]buy ivermectin nz[/url] [url=https://bupropionxr.com/]buy bupropion[/url] [url=https://diclofenacv.com/]diclofenac gel buy over the counter canada[/url] [url=https://finasteridesale.com/]where to get propecia in canada[/url] [url=https://tretinoin05.com/]tretinoin[/url] [url=https://robaxin24.com/]buy robaxin[/url] [url=https://cleocincr.com/]buy cleocin online[/url] [url=https://stromectolotc.com/]ivermectin buy online[/url] [url=https://zithromax100.com/]zithromax online[/url]

  30. JudyJaild说:

    [url=https://retina05.com/]retin a[/url] [url=https://cialis4.com/]rx cialis[/url] [url=https://finasteridesale.com/]finasteride medication[/url] [url=https://stromectolav.com/]cheap stromectol[/url] [url=https://cipro24.com/]cipro 500[/url] [url=https://ivermectinotc.com/]stromectol over the counter[/url] [url=https://hydroxychloroquinesale.com/]buy hydroxychloroquine uk[/url] [url=https://tadalafiltab.com/]cheapest tadalafil india[/url] [url=https://bupropionxr.com/]bupropion xl 150 mg online[/url] [url=https://cleocincr.com/]cleocin topical gel[/url]

  31. SueJaild说:

    [url=https://abilifyrx.com/]abilify prescription uk[/url] [url=https://stromectolmed.com/]ivermectin canada[/url] [url=https://stromectolivermectin.com/]stromectol generic canada[/url] [url=https://viagrasoftab.com/]viagra soft tabs online[/url] [url=https://amoxicillinab.com/]amoxicillin 400 mg price[/url] [url=https://erythromycinlab.com/]erythromycin capsules brand[/url] [url=https://paxil365.com/]paxil 80 mg[/url] [url=https://finpecia24.com/]finpecia online india[/url] [url=https://stromectolav.com/]stromectol buy[/url] [url=https://ivermectinbuy.com/]buy ivermectin nz[/url]

  32. JudyJaild说:

    [url=https://abilifyrx.com/]abilify 15 mg tablet[/url] [url=https://ivermectintab.com/]where to buy ivermectin pills[/url] [url=https://clonidine911.com/]buy clonidine[/url] [url=https://finasteridesale.com/]how to buy propecia in canada[/url] [url=https://bupropionxr.com/]cheap bupropion[/url] [url=https://hydroxychloroquineonline.com/]quineprox 750mg[/url] [url=https://erythromycinlab.com/]erythromycin buy[/url] [url=https://finpecia24.com/]finpecia[/url] [url=https://stratterra.com/]strattera capsules 40 mg[/url] [url=https://ivermectinstromectol.com/]ivermectin stromectol[/url]

  33. cbd oil说:

    A person necessarily lend a hand to make severely posts I would state. This is the first time I frequented your website page and thus far? I amazed with the research you made to create this actual publish extraordinary. Fantastic job!|

  34. CarlJaild说:

    [url=https://stromectolmed.com/]stromectol medicine[/url] [url=https://cleocincr.com/]generic cleocin[/url] [url=https://hydroxychloroquinesale.com/]plaquenil buy[/url] [url=https://viagrasoftab.com/]generic viagra soft tabs online[/url] [url=https://baclofenmed.com/]buy baclofen[/url]

  35. PaulJaild说:

    [url=https://diclofenacv.com/]buy diclofenac[/url] [url=https://hydroxychloroquinelab.com/]buy hydroxychloroquine[/url] [url=https://stromectolotc.com/]stromectol buy[/url] [url=https://hydroxychloroquineonline.com/]hydroxychloroquine online[/url] [url=https://tamoxifen24.com/]buy tamoxifen[/url]

  36. EyeJaild说:

    [url=http://brattrick.hollosite.com/jump.php?url=http://www.chloroquine24.com/]chloroquine online[/url] [url=http://www.plevenon-meteo.info/livredor/signatux/redirect.php?p=http://www.chloroquine24.com/index.html]buy chloroquine[/url] [url=http://usolie.info/bitrix/redirect.php?event1=&event2=&event3=&goto=http://chloroquine24.com/index.html]purchase chloroquine[/url] [url=http://yagotin.com/redirect?url=http://chloroquine24.com/index.html]hydroxychloroquine[/url] [url=http://old.sibindustry.ru/links/out.asp?url=https://www.chloroquine24.com/index.html]buy chloroquine online[/url] [url=http://mmorpgadvertising.com/ads/click.php?a=25&x=TVRVeE5EWTBNelE0TVMwMk5pNHlORGt1TnpVdU13PT0=&client=&z=43&d=1&adurl=13202569&url=https://chloroquine24.com/index.html]buy chloroquine[/url] [url=http://stsplacements.co.za/print_version.php?auth_sess=jnvic8peaumafu9m3hk1aoioj6&ref=5a6fe411616f44a20c5ad0735&url=http://chloroquine24.com/index.html]hydroxychloroquine for sale[/url] [url=http://portal.mbsfestival.com.au/eshowbag/redirect.php?type=website&url=http://www.chloroquine24.com/]buy hydroxychloroquine online[/url] [url=http://kolbitec.ru/bitrix/rk.php?goto=https://www.chloroquine24.com/index.html]purchase hydroxychloroquine[/url] [url=https://www.webkinz.com/bumper.php?clicktag=https://www.chloroquine24.com/index.html]buy hydroxychloroquine online[/url] [url=http://www.allhyipmonitors-2016.buy4script.net/goto.php?url=http://chloroquine24.com/]chloroquine[/url] [url=http://gidmadeira.ru/go?url=http://www.chloroquine24.com/index.html]buy hydroxychloroquine online[/url] [url=http://bu-market.ru/bitrix/redirect.php?event1=&event2=&event3=&goto=http://chloroquine24.com/index.html]buy chloroquine online[/url] [url=http://www.chinalink.de/cgi-bin/clickcount.pl?url=https://chloroquine24.com/]chloroquine[/url] [url=http://adcenter.conn.tw/email_location_track.php?eid=5593&role=mymall&member=af000034961&to=http%3A%2F%2Fchloroquine24.com%2Findex.html]buy chloroquine[/url] [url=http://infonarod.ru/away.php?url=https://www.chloroquine24.com/]hydroxychloroquine over the counter[/url] [url=https://login.libproxy.berkeley.edu/login?qurl=https%3A%2F%2Fchloroquine24.com%2Findex.html]chloroquine for sale[/url] [url=http://trackometry.com/link.htm?camp=456&i=0&r=9558&orig=http://chloroquine24.com/index.html]chloroquine online[/url] [url=http://m.shopinirvine.com/redirect.aspx?url=http://chloroquine24.com/index.html]hydroxychloroquine[/url] [url=https://www.thoroughbredpeople.com/api/clickthrough.php?type=hbanner&id=120&url=https://www.chloroquine24.com/index.html]buy hydroxychloroquine[/url]

  37. MiaJaild说:

    [url=https://hydroxychloroquinesale.com/]buy hydroxychloroquine online[/url] [url=https://finasteridesale.com/]propecia cheapest price australia[/url] [url=https://cephalexina.com/]how much is cephalexin 500 mg[/url] [url=https://hydroxychloroquineonline.com/]plaquenil 100[/url] [url=https://bupropionxr.com/]bupropion 100 mg[/url]

  38. AlanJaild说:

    [url=https://viagrasoftab.com/]buy viagra soft tabs[/url] [url=https://ivermectin24.com/]ivermectin uk[/url] [url=https://hydroxychloroquinesale.com/]hydroxychloroquine sale[/url] [url=https://hydroxychloroquine911.com/]plaquenil 800mg[/url] [url=https://robaxin24.com/]how much is robaxin in canada[/url] [url=https://amoxila.com/]buy generic amoxil[/url] [url=https://femalesviagra.com/]where to buy female viagra uk[/url] [url=https://clonidine911.com/]clonidine online pharmacy[/url] [url=https://medrolpack.com/]medrol pack[/url] [url=https://stratterra.com/]order strattera[/url] [url=https://hydroxychloroquinelab.com/]hydroxychloroquine virus[/url] [url=https://ivermectintab.com/]buy stromectol uk[/url] [url=https://stromectolpill.com/]ivermectin cost in usa[/url] [url=https://ivermectinvir.com/]ivermectin online[/url] [url=https://stromectolmed.com/]ivermectin for humans[/url] [url=https://bupropionxr.com/]bupropion 150 mg coupon[/url] [url=https://trazodone24.com/]trazodone 500 mg[/url] [url=https://ivermectinstromectol.com/]buy ivermectin canada[/url] [url=https://stromectol24.com/]stromectol 3mg[/url] [url=https://neurontin2.com/]buy neurontin[/url]

  39. MarkJaild说:

    [url=https://cymbaltamed.com/]cymbalta generic[/url] [url=https://ivermectinbuy.com/]buy stromectol[/url] [url=https://ivermectinotc.com/]ivermectin 3mg for lice[/url] [url=https://stratterra.com/]buy strattera without prescription[/url] [url=https://augmentinsr.com/]buy augmentin over the counter[/url] [url=https://abilifyrx.com/]abilify buy[/url] [url=https://hydroxychloroquineonline.com/]cheapest plaquenil[/url]

  40. DenJaild说:

    [url=http://ivermectin24.com/]ivermectin pills[/url] [url=http://viagrasoftab.com/]viagra soft tabs uk[/url] [url=http://ivermectintab.com/]buy ivermectin[/url] [url=http://hydroxychloroquinelab.com/]hydroxychloroquine plaquenil[/url] [url=http://stratterra.com/]200 mg strattera[/url]

  41. SueJaild说:

    [url=https://glucophaqe.com/]buy glucophage online uk[/url] [url=https://ivermectintab.com/]buy stromectol[/url] [url=https://ivermectin24.com/]ivermectin otc[/url] [url=https://femalesviagra.com/]purchase female viagra online[/url] [url=https://finpecia24.com/]finpecia online[/url] [url=https://cymbaltamed.com/]cymbalta cheap[/url] [url=https://tamoxifen24.com/]buy tamoxifen 20mg uk[/url] [url=https://clonidine911.com/]buy clonidine[/url] [url=https://diclofenacv.com/]diclofenac 500mg[/url] [url=https://prednisonecort.com/]buy prednisone[/url]

  42. PaulJaild说:

    [url=https://finpecia24.com/]finpecia[/url] [url=https://cymbaltamed.com/]cymbalta 30 mg coupon[/url] [url=https://stromectolmed.com/]stromectol medication[/url] [url=https://ivermectinotc.com/]ivermectin over the counter[/url] [url=https://ivermectin3.com/]ivermectin 3mg[/url]

  43. SueJaild说:

    [url=https://diclofenacv.com/]diclofenac cream australia[/url] [url=https://abilifyrx.com/]generic for abilify[/url] [url=https://hydroxychloroquine911.com/]buy hydroxychloroquine over the counter[/url] [url=https://paxil365.com/]paxil ssri[/url] [url=https://stromectolotc.com/]buy stromectol pills[/url] [url=https://hydroxychloroquineplaq.com/]hydroxychloroquine online[/url] [url=https://stromectolivermectin.com/]cost of ivermectin[/url] [url=https://stromectol24.com/]stromectol cream[/url] [url=https://hydroxychloroquinelab.com/]can you buy plaquenil in mexico[/url] [url=https://femalesviagra.com/]womens viagra[/url]

  44. CarlJaild说:

    [url=https://ivermectin24.com/]stromectol tab price[/url] [url=https://prednisonecort.com/]order prednisone 10mg[/url] [url=https://stromectolotc.com/]ivermectin medicine[/url] [url=https://stromectol24.com/]stromectol australia[/url] [url=https://finpecia24.com/]finpecia 1mg[/url]

  45. JasonJaild说:

    [url=http://stromectol24.com/]stromectol 3 mg tablet[/url] [url=http://bupropionxr.com/]buy bupropion[/url] [url=http://ivermectinstromectol.com/]ivermectin oral solution[/url] [url=http://stromectolpill.com/]stromectol pills[/url] [url=http://abilifyrx.com/]cymbalta abilify[/url] [url=http://hydroxychloroquinelab.com/]buy hydroxychloroquine[/url] [url=http://medrolpack.com/]medrol pack[/url] [url=http://stromectolmed.com/]stromectol usa[/url] [url=http://amoxicillinab.com/]amoxicillin 875 mg tablet[/url] [url=http://amoxila.com/]buy amoxil[/url]

  46. UgoJaild说:

    [url=http://sumycintet.com/]buy sumycin[/url] [url=http://zovirax24.com/]how much is zovirax cream[/url] [url=http://lopressormetoprolol.com/]lopressor 25 mg cost[/url] [url=http://neurontingabapentin.com/]buy neurontin[/url] [url=http://doxy24.com/]doxy[/url] [url=http://flagylmed.com/]flagyl generic[/url]

  47. EyeJaild说:

    [url=http://diflucanrx.com/]diflucan medicine pill[/url] [url=http://silagratab.com/]buy silagra[/url] [url=http://azithromycin36.com/]buy azithromycin[/url] [url=http://amoxicillincap.com/]amoxicillin brand name canada[/url] [url=http://kamagratab.com/]kamagra gel south africa[/url] [url=http://zovirax24.com/]zovirax cream[/url] [url=http://effexorsr.com/]buy effexor[/url] [url=http://flomaxtamsulosin.com/]flomax buy[/url] [url=http://trentalpentoxifylline.com/]trental 400 mg buy online india[/url] [url=http://yasmindrospirenone.com/]yasmin pharmacy[/url] [url=http://avanafill.com/]3131 avana[/url] [url=http://lopressormetoprolol.com/]buy lopressor online[/url] [url=http://lisinoprilsale.com/]lisinopril 10mg[/url] [url=http://triamterenebenzathiazide.com/]buy triamterene[/url] [url=http://benicar365.com/]benicar hctz[/url] [url=http://neurontingabapentin.com/]neurontin 400 mg[/url] [url=http://sildenafilctrt.com/]sildenafil citrate generic[/url] [url=http://sumycintet.com/]buy sumycin[/url] [url=http://doxy24.com/]buy online doxycycline without prescription[/url] [url=http://prednisonegen.com/]prednisone 50 mg prices[/url]

  48. JimJaild说:

    [url=https://trentalpentoxifylline.com/]trental 400 mg[/url] [url=https://triamterenebenzathiazide.com/]triamterene hctz 37.5 25 mg[/url] [url=https://diflucanrx.com/]diflucan pills online[/url] [url=https://yasmindrospirenone.com/]buy yasmin online[/url] [url=https://flomaxtamsulosin.com/]generic for flomax[/url] [url=https://tenorminatenolol.com/]tenormin over the counter[/url] [url=https://