计算多个文件中的字频 - calculate word frequency in multiple files

calculate word frequency in multiple files

本文关键字：字频文件计算 | 更新日期: 2023-09-27

<?php

$filename = "largefile.txt";

/* get content of $filename in $content */
$content = strtolower(file_get_contents($filename));

/* split $content into array of substrings of $content i.e wordwise */
$wordArray = preg_split('/[^a-z]/', $content, -1, PREG_SPLIT_NO_EMPTY);

/* "stop words", filter them */
$filteredArray = array_filter($wordArray, function($x){
return !preg_match("/^(.|a|an|and|the|this|at|in|or|of|is|for|to)$/",$x);
});

/* get associative array of values from $filteredArray as keys and their frequency count as value */
$wordFrequencyArray = array_count_values($filteredArray);

/* Sort array from higher to lower, keeping keys */
arsort($wordFrequencyArray);

这是我实现的代码，用于找出文件中不同单词的频率。这是有效的。

现在我想做的是，假设有 10 个文本文件。我想计算所有 10 个文件中单词的单词频率，即如果我想在所有 10 个文件中查找单词"堆栈"的频率，即单词堆栈在所有文件中出现的次数。然后对所有不同的单词都这样做。

我已经为单个文件完成了此操作，但无法了解如何将其扩展到多个文件。谢谢你的帮助，对不起我的英语不好

将你所拥有的东西放入一个函数中，并使用 foreach 循环为数组中的每个文件名调用它：

<?php
$wordFrequencyArray = array();
function countWords($file) use($wordFrequencyArray) {
    /* get content of $filename in $content */
    $content = strtolower(file_get_contents($filename));
    /* split $content into array of substrings of $content i.e wordwise */
    $wordArray = preg_split('/[^a-z]/', $content, -1, PREG_SPLIT_NO_EMPTY);
    /* "stop words", filter them */
    $filteredArray = array_filter($wordArray, function($x){
        return !preg_match("/^(.|a|an|and|the|this|at|in|or|of|is|for|to)$/",$x);
    });
    /* get associative array of values from $filteredArray as keys and their frequency count as value */
    foreach (array_count_values($filteredArray) as $word => $count) {
        if (!isset($wordFrequencyArray[$word])) $wordFrequencyArray[$word] = 0;
        $wordFrequencyArray[$word] += $count;
    }
}
$filenames = array('file1.txt', 'file2.txt', 'file3.txt', 'file4.txt' ...);
foreach ($filenames as $file) {
    countWords($file);
}
print_r($wordFrequencyArray);